Relatively Open Gromov-Witten Invariants for Symplectic 
Manifolds of Lower Dimensions 

Hai-Long Her* 



Abstract. Let (X, oS) be a compact symplectic manifold, L be a Lagrangian sub- 
manifold and V be a codimension 2 symplectic submanifold of X, we consider the 
pseudoholomorphic maps from a Riemann surface with boundary (£,c?£) to the pair 
(X, L) satisfying Lagrangian boundary conditions and intersecting V. We study the 
stable moduli space of such open pseudoholomorphic maps involving the intersection 
data. Assume that L P\V = $ and there exists an anti-symplectic involution on X 
such that L is the fixed point set of (j> and V is 0-anti- invariant. Then we define the 
so-called "relatively open" invariants for the tuple (X,u!,V,<p) if L is oricntable and 
dimX < 6. If L is nonorientable, we define such invariants under the condition that 
dimX < 4 and some additional restrictions on the number of marked points on each 
boundary component of the domain. 
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1 Introduction 

Classical Gromov-Witten invariants GW gn (X, A) for a symplectic manifold (X,u) 
count with sign the (J, z^)-stable maps u from the compact Riemann surface X 5in of genus 
g with n marked points to the symplectic manifold (X,u), representing the homology 
class A £ H2(X) and satisfying some constraints, where J is a w-compatible or w-tamed 
almost complex structure on X and v is an inhomogeneous perturbation satisfying the 
J-holomorphic map equation dju = v. Such invariants originate from Ruan's introducing 
Donaldson type invariants in symplectic category (see [R])- The rigorous mathematical 
foundation of GW invariants was first established by Ruan-Tian |RT1] for semi-positive 
symplectic manifolds in 1993. Then many mathematicians contribute to the development 
and completion of such theme (see |FO] |KM] |LiT] [RT2 j [ ST] ) . In many cases these numbers 
coincide with the enumerative invariants in algebraic geometry. In order to find effective 
ways of computing these invariants, Tian (Tlj first showed a rough description of study- 
ing the degeneration of rational curves under a symplectic degeneration, an operation 
of 'splitting the target'. Then Ionel-Parker |IP1]|IP2] and Li-Ruan |LR| independently 
defined the so-called relative Gromov-Witten invariants with respect to a codimension 2 
symplectic submanifold V and also established the symplectic connect sum formula for 
GW invariants. 

For recent years, theoretic physicists have predicted the existence of enumerative invari- 
ants about pseudoholomorphic curves with Lagrangian boundary conditions by studying 
dualities for open strings (see |AK V] [DV] ) ■ Roughly speaking, let L C X be a Lagrangian 
submanifold, such invariants would count pseudoholomorphic maps from a Riemann sur- 
face with boundary (X,<9£) to (X,L), representing a relative class d £ H2(X,L), such 
that the boundary is mapped in the Lagrangian submanifold. 

There are two main difficulties in defining such invariants: orientability of moduli space 
and codimension 1 bubbling-off phenomenon. We denote by Aik L, d) the moduli space 
of such maps u with k distinct marked points in dT, and I distinct marked points in E, 
and its compactfication by .Mfc z(£, L, d). Therefore, we have canonical evaluation maps 
at marked points 

evbi : Mk,i(^,L,d) ->■ L, i = l,---,k, 

evij : Mk,i(E,L,d) ->• X, j = l, 

Note, by [FQOOj |Silj . that «Mfc^(S, L, d) might be non-orientable. If L is relatively spin, 
then Fukaya et al. [FOOOj proved that the moduli space is orientable. Katz-Liu |KL] |Liuj 
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defined an open invariant under the much restricted assumption that there exists an addi- 
tional 5 1 -action on the pair (X, L). To define an orientation on the moduli space, they also 
assumed the Lagrangian submanifold L is orientable and (relatively) spin. The orientabil- 
ity of moduli space seems important for Katz-Liu's definition of enumerative invariants. 
However, J. Solomon |Soj showed that even if L is not orientable, under the weaker as- 
sumption that L is 'relatively Pin 1 * 1 ' and some constraints on the number of boundary 
marked points, we still can obtain a canonical isomorphism from the orientation bundle 
of Mk i(Yi,L,d) to the pullbacked line bundle from the orientation bundle of L k by the 
evaluation map \\ i evbi. Although the moduli space Mk,i(E>, L,d) may be nonorientable, 
the integral of det(TL)-valued forms over Mk,iC^, L, d) would make sense. 

On the other hand, we at present have no effective method to completely deal with the 
codimension 1 boundary of moduli space coming from the bubbling off discs. According 
to the discussion in |AKV] . in order to define an invariant independent of other choices, 
it seems necessary to introduce some additional parameter on (X,L). For instance, the 
assumption in |Liuj that there exists an 5 1 -action is used to cancel the codimension 1 
boundary of moduli space. In the paper [So], under the assumption that there exists an 
anti-symplectic involution 

(j) : X — > X, (f>*uj = —lj, 

such that L = Fix(</>), and among other technical conditions, Solomon constructed the 
open invariants for dimA < 6 if L is orientable and, for dimA < 4 even if L might be non- 
orientable. Note that, from the viewpoint of real algebraic geometry, the assumption that 
symplectic manifold admits an anti-symplectic involution is much natural. Actually, in 
that paper, Solomon also showed that, for the genus zero domain curve and strongly semi- 
positive real symplectic manifold of dimension no more than 6, his open invariants exactly 
coincide with twice of the Welschinger's invariants which can be regarded as a lower bound 
of the number of real rational curves in a real symplectic manifold(cf. f\V 1 |W2] [W3]). 
Independently, Cho [C], with different way of counting, also defined similar enumerative 
invariants for strongly semi-positive symplectic manifold with dimX < 6, genus g = 0, 
and L being relatively spin. 

The aim of this article is to show a definition of "relatively open Gromov-Witten 
invariants" which count stable maps u : (£,<9X) — > (X,L) from a compact Riemann sur- 
face with boundary whose images intersect with a codimension 2 symplectic submanifold 
V C X, satisfying Lagrangian boundary conditions. These invariants are designed for a 
preparation of establishing open symplectic sum formulas, which will be used to compute 
open Gromov-Witten invariants of a symplectic connect sum of two symplectic manifolds 
(X,Lx,V) and (Y, Ly,V). More concretely, the symplectic sum is an operation that 
first removes V and V from X and Y, respectively, and then combines them into a new 
symplectic manifold Xj^Y with symplectic structures matching on the overlap region. 
A stable map into the sum is expected to be a pair of stable maps into the two sides 
which match in the middle. So the first step is to count stable maps in one side X which 
record the intersection points with V and multiplicities. At present, we only construct 
such invariants under the additional assumptions that L is the fixed point set of an anti- 
symplectic involution, dimA < 6 and L n V = 0. However, for possible applications in 
the future, we will define the related moduli space and study the problem of orientability 
for more general situation. An axiomized formulation of the symplectic sum of open GW 
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invariants has appeared in jLiuYj . 

Similar to the absolute case in [IP 1 j . before considering such stable maps we have to 
extend J and v to the connect sum. The V -compatibility conditions imposed on the pair 
(J, v) defined in Section 0] ensure that such an extension exists. However, these conditions 
do not always hold for generic (J, is). Our relatively open invariants count stable maps 
for these special ^-compatible pairs, which are different from the way of counting of the 
absolute open GW invariants. Given such a special ^-compatible pair (J,v), V is a J- 
holomorphic submanifold, and a J-holomorphic map u : (£, <9E) — > (V,Ly) (if Ly = 
L n V ^ 0) into (V,Ly) is automatically a J-holomorphic map into (X,L). Therefore, 
some domain components (closed or open) of stable maps maybe mapped entirely into 
V. Such maps are not transverse to V and the moduli space of such maps may be of 
dimension larger than the expected dimension of Mk i(E, L, d). 

To avoid such non-transversal intersections, we restrict consideration to the so-called 
^-regular open stable maps which have no components mapped entirely into V. We note 
that such maps may intersect V at finite many points (interior or boundary intersection 
points) with multiplicity. According to the ordering of these intersection points, the space 
of F-regular stable maps separates into components labeled by pairs of vectors (r, $), 
where r = (ri, • • • , r^) and s = (s±, ■ ■ ■ , si). The subscript k (resp. 1) denotes the number 
of boundary (resp. interior) intersection points and r, (resp. Sj) denotes the multiplicity 
of the i th (resp. j th ) boundary (resp. interior) intersection point. Then in Section [5l we 
will study the moduli space A4^(S,L,d) of such ^-regular stable maps. We will prove 

that each irreducible component M^i'^JX, L,d) of V-regular maps is a manifold with 
boundary whose dimension is expressed in (|5.3p . 

In Sections [6] and we consider the compactification of the moduli space of Ir- 
regular open maps — the space of F-stable open maps, of which each component is a 
subset of the closure of the ^/-regular space A4^ r f ,(£, L, d) in the stable moduli space 

A4k+u,i+i(£>, L, d). We will show that the irreducible part of this compactification is a 
manifold with boundary. The key observation is that each sequence {u n } of ^-regular 
open maps limits to a stable map u with additional restriction. For instance, if the im- 
age of a component of such a limit map lies entirely in V (or (V,Ly)), then along this 
component, we can find a section £ of the normal bundle of V (or (V, Ly)), such that the 
elliptic equation D N £ = holds, where D N is the restriction of the linearization operator 
of dj yU to the normal bundle of V (or (V, Ly)). Stable maps with this additional restriction 
are called V-stable maps. Each component of the space of T^-stable maps is denoted by 
■MfcVb L, d), which is the compactification of the space of ^-regular open maps with 
frontier strata of codimension at least one. To analyze the convergence of sequences of 
^-regular maps, we use the renormalization technique similar to ones in [IP 1J and [Tj . 

Then we come to define relative invariants for the case LdV = 0. Let us introduce some 
more delicate notations. Recall that the maps we consider are (j, J, i/)-holomorphic maps u 
from a bordered Riemann surface (S, <9£) with fixed conformal structure j to a symplectic- 
Lagrangian pair (X, L) satisfying Lagrangian boundary conditions and representing a fixed 
relative homology class d G H^(X, L). We suppose the boundary of E has m components, 
i.e. dT, = U^Li(^^)a with each (dT,) a ~ S . Moreover, we also require that the image 
of each boundary component represents a fixed homology class, i.e. u|(0£) o *([(c?£) a ]) = 
d a G H\(L). Suppose that there are k a marked points z a ±,--- , z a k a on each boundary 
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component (<9S) a and I marked points w±, ■ ■ ■ ,W\ and additional (. = 1 intersecting marked 
points q\, ■ ■ • , qi on £0 We reset 

d = (d, di, ■ ■ ■ , d m ) € fT 2 (X, L) © #i(L)® m , 

m 

k = (fei, • • • , & m ), |k| = ^ ^ /c a , 

a=l 

u = (u,z,w,q), z = (z ai ), w = ( Wj ), q=(q 3 ). 

Then we rewrite the moduli space of ^/-regular maps u by \(X, L, d). The compact- 
y $ 

ification A4 k \ i(X, L, d) is the space of F-stable open maps. 

There are some natural evaluation maps at those marked and intersection points 

y ffi 

evb a i : M^jiX, L, d) -)• L, i = 1, • • • , k a , a = 1, • • • , m, 

evij : AT k; y(X, L, d) — > X, j = !,-■■ ,1, 

evi] :Ml] l j(X,L,d)^V, j = l, 
The first problem is the orientability of the moduli space. To get a more general result, 

y s 

we do not expect M^'i \{X, L, d) to have a canonical orientation, which means that there 

y s 

is a canonical orientation on the orientation line bundle det(A^i c '; L, d)). Instead, we 
only want to construct an orientation on a modified line bundle 

det(TMl]ij(X, L, d)) <g)(evb* ai det(TL). 

a,i 

The conditions that ensure there exists such an orientation are that the Lagrangian sub- 
manifold L is "relatively Pin ± " (see Definition 18. ip and some restrictions imposed on the 
boundary marked points. In Section [S] we obtain the following result. 

Theorem 1.1 Assume L is relatively Pin and fix a relative Pin^ structure on (X,L). 
If L is not orientable, we assume k a = wi(d a ) + 1 mod 2. If L is orientable, fix an 
orientation. Then the relatively Pin structure on (X, L) and the orientations of L if it 
is orientable determines a canonical isomorphism 

det(TMl'^(X, L, d))=> (g) evb* at det(TL). (1.1) 

a,i 

Remark. By the Wu relation jMSj . if n < 3 then L is always Pin~ . 

Given the isomorphism (jl.ip . we can define the relatively open invariants as follows. 
Denote the images of marked points under evaluation maps by 

Xai = u(z ai ), yj = u(vjj), qj = u(q 3 ) . 
J To avoid some kind of bubbling, in this article, we require that if E ~ D 2 , k > 0. 
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Let Q*(L, det(TL)) denote differential forms on L with values in det(TL), and let £l*(X) 
(resp. Q*(V)) denote ordinary differential forms on X (resp. V). Let a a i G fi n (L, det(TL)), 
a = 1, • • • , m; i = 1, • • • , k a , represent the Poincare dual of the point x a i in H n (L, det(TX)), 
which is the cohomology of L with coefficients in the flat line bundle det(TL). Let 
jj G Q 2n (X) represent the Poincare dual of yj for j = 1, • • • ,/. And let r/j G f2 2n_2 (V) 
represent the Poincare dual of for j = 1, • • • ,1. Then we define 

= f f\ evb* ai (a ai ) f\ evifaj) f\ emffa) . (1.2) 

The integral (|1.2|) makes sense because by Theorem ll.il the integrand is a differential 
form taking values in the orientation line bundle of the ^-stable moduli space. Denote by 
fj, : H2(X,L) — > Z the Maslov index, and by g the genus of the closed Riemann surface 
£ Ugs S which is the complex double of S. From the dimensional calculation (|5.3p we 
know that the integral above vanishes unless 

(|k| + 2l)n + 2£(n - 1) = n(d) + n(l - g) + k 

+2(/ + £-deg s) -dimAui(E). (1.3) 

where deg $ = ]Cj=i s i- 

In general, the integral (jl.2p might depend on the choice of the forms a a i, etc., because 
the codimension 1 boundary strata would contribute to the integral. To prove the invari- 
ance of the integral (jl.2p , we suppose that there exists an anti-symplectic involution <p on 
X, i.e. (j)*u) = —uj, such that L = Fix(</>) and the restriction of 4> to V is also an involution 
on the submanifold. Furthermore, suppose X is biholomorphic to its conjugation S, i.e. 
there exists an anti-holomorphic involution c : S — > S. Denote by the set of w-tamed 
almost complex structures on X. Let V denote the set of J-antidinear inhomogeneous 
perturbation terms. Define 

Ju>,4> ■= {J e Ju\ <t>*J = -J}- 

Now for each J G Ju,</>, we denote by T 3 ^ c the set oi u E V satisfying dcj) o u o dc = v. 
Denote 

J:={(J,i/)|J€ J w ,i/€P}, 

:= {(j, f)|J g x^, ^ e p£j c jr. 

Fix (J, v) G JT^ . Thus, from the I^-stable (J, i/)-holomorphic map u : (£, c?£) i— >• (X, L) 
we can define its conjugate V^-stable (J, ^)-holomorphic map u = (pouoc representing the 
homology class [u] = —cfr*d, simply denoted by d. Denote d = (d,d±, ■ ■ ■ , d m ). So we have 
an induced map 

<f>' ■ mZ^(x, L, d) -> mI^x, L, d) 

given by 

u = (u, z, w, q) !->■ u = (u, (c\oy;) W (z), c l (w), c l {q)). 

Define 

%(X) := { 7 GO*(X)| ^ 7 = 7 }, 



%(V) := {rj G 0*(V)| ^ = 7?}. 

Now in the integral (|1.2p we take the forms 7j G fij n p0 and rfr G Oj n " 2 (F). 

Then we study the lower dimensional cases, i.e. n < 3. If <i = d, then using the method 

in this paper (see Sections IB Hlip . we can show that the integrals (|1.2p are invariants of 

the tuple (X,u,V,4>). Roughly speaking, we can show that the map <j>' is an induced 

involution on the V-stable moduli space Ai^'u(X, L,d). And using the isomorphism 

(jl.ip . we can assign a sign to each V^-stable map (see Section [9]). Then we can prove that 

on each codimension 1 boundary stratum, the induced involution eft' is fixed point free and 

orientation reversing, i.e. changing the sign of each disc-bubbling stable map. Therefore, 

Y s 

the contributions from the codimension 1 boundary of -M k ' ; i(X, L, d) to the integrals (|1.2p 
are eliminated. That implies the invariance. 

However, for general situation, the relative homology class d might not be 0-anti- 
invariant, then <f>' might not be a map from the space of F-stable maps to itself. Thus the 
numbers £%Jf are not always well-defined invariants. So we have to modify the definition 
above. 

The idea is to take all related moduli space together to eliminate the contributions from 
the codimension 1 boundaries to the integral. In fact, such boundary-canceling method 
has been used in [C] , 

For a homology class a G H2(X) and a relative class A G H2(X,L), we say Ac = d if 
there is a holomorphic map u of class (5 such that its complex double uq represents the 
homology class a. In this sense, we may say a = Ac is the doubling of /3. Note that 
Ac = (A)c- Denote by d = dc the homology class in H2(X) which is the doubling of d, 
and by a = (a a i), 7 = ( 7 j), fj = Then we define 

E E 

V/3 : Ac = d 7i : [ 7i ] = PD(^), '/, : fa] = PD(A,), 

V(x, \)eK 

VtB _ f\evb* ai (a ai ) /\em*( 7j ) ^evi 1 / (rjj) , (1.4) 

- -k',Ll( x > L ^) a .i j J 

where 1Z is the space of real configurations (see Section [10j (|10.6p for detailed definition), 
P = (A, di, • • • , d m ) G H 2 (X, L) Fi(L)® m , PD(-) is the Poincare dual of the point class. 
Now, we state our main result. 

Theorem 1.2 Assume that L n V = 0, and that dimX < 6, if L is not orientable, we 

Y s - 

assume that dimX < 4 and k a = w\{d a ) + 1 mod 2. If each moduli space M-^i \{X, L, A) 
generically contains no (p-multiply covered pseudoholomorphic dis$, then the integers X = 
X X^ S g d k l are independent of the generic choice of pair (J, v) G JlY, the choice of conformal 
structure j, or the choice of forms ct ai G Q n (L, det(TL)), 7 j G Vt 2 ^(X), rj 3 G n 2 £~ 2 (V). 
Therefore, X are invariants of the tuple (X,u,V,(j)). 

2 A nonconstant map u : (E, <9E) — > (X, L) is called 4>-multiply covered or not <j>- somewhere injective if 
there exists a regular point z G E such that either u(z) € u(E \ {z}) or £ Im(</> o u). 
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Remark. In particular, if d = d, £%JV := M^(V,d,]c,l,l) are invariants of the tuple 
(X, u), V, <fi). S%.JV can be regarded as an extension of Solomon's definition of open GW 
invariants iV^d.k,; to the relative case. 

Remark. In the proof of Theorem 11.21 in Section \TT\ we use the assumption that there is 
no ^-multiply covered pseudoholomorphic disc. Actually, we believe, by using the virtual 
cycle techniques to the case of open maps or defining the equivariant Kuranish structure 
like what Solomon has done in section 7 of |Soj . that such assumption is not necessary 
and the Theorem 11.21 holds for general case. 

In Section [8j we deal with the problem of orientation and derive the conclusion of 
Theorem II .li Then in Section [9l we assign a sign to each U-stable map and study how the 
induced action by involution changes the sign. The last two sections devote to the proof 
of Theorem 11.21 The content of Sections [2] and [3J is preparation for succeeding discussion, 
in Section [21 we show the definition of stable open ( J, z/)-holomorphic maps and describe 
the moduli space of such maps. And we outline the constructions of classical GW, relative 
GW and Solomon's open GW invariants (with somewhat more general formulation) in 
Section [3l For the convenience of the reader, in | Appendix we review some definitions and 



important conclusions in |Soj about the orientation of determinant of real linear Cauchy- 
Riemann operator. 
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2 Stable open pseudo-holomorphic maps 

In this section, we show the definition of stable open (J, ^)-holomorphic maps, and 
describe the moduli space of such maps. The domains of such stable open maps are bor- 
dered Riemann surface i.e. compact Riemann surface with boundary, smooth or allowing 
nodal singularities. The boundary is mapped in a Lagrangian submanifold. 

In the following, both marked points and double points (or singular points or nodes) 
are called special points. And we always fix a conformal structure on the open domain 
curve E, which is a bordered compact Riemann surface. We say such curve is of genus g if 
the closed Riemann surface E Ugs E, which is the complex double of E and also denoted 
by Ec (see [AGj ) . is of genus g. Denote the genus of the closed surface E/<9E by go. 

Assume that there are altogether m boundary components, i.e. <9E = UoLi(^^)a- We 
say E is of topological type (go,m). 

Definition 2.1 An automorphism of a bordered Riemann surface E is a diffeomorphism 
tp : E — > E preserving the conformal structure and the ordering of the boundary compo- 
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nents. The set of all automorphism of £ is denoted by Aut(£). We say £ is stable if 
Aut(E) is finite. 

Denote by £c the complex double of £, which is a closed Riemann surface with an an- 
tiholomorphic involution a. If ip : £ — > £ is an automorphisim, then its complex dou- 
ble if£ : £c £c is an automorphism of (£c,c). This provides a natural inclusion 
Aut(£) C Aut(Sc,cr). The following statements are equivalent: 

• £ is stable, i.e., Aut(£) is finite. 

• £c is stable. 

• The genus g = 2gQ + m — 1 of £c is bigger than one. 

• The Euler characteristic x(E) = 2 — 2g$ — m of £ is negative. 

Definition 2.2 A prestable bordered Riemann surface with fixed conformal structure is 
either a smooth bordered Riemann surface or the union of a smooth bordered Riemann 
surface with finite sphere and disc bubbles. 

In this paper, we only consider the prestable bordered Riemann surfaces with fixed con- 
formal structure, and simply call them prestable bordered Riemann surfaces. 

Definition 2.3 An automorphism of a prestable bordered Riemann surface £ of topolog- 
ical type (go,m) with (k, /) marked points 

(£,£>£, z» = (£,{(d£) a }™ =1 ,{w ,z aka }™ =1 , Wl ,--- ,wi) 

is an automorphism of £ preserving all marked points. The set of all automorphism is 
still denoted by Aut(£). A prestable (k, I) -marked bordered Riemann surface T, is stable if 
Aut(£) is finite. 

Definition 2.4 A (k,l)-marked bordered bubble domain curve £ of type (go,m), which 
is also called a prestable (k, /) -marked bordered Riemann surface and where the vector 
k = (/si,-- - ,k m ), is a finite connected union of smooth oriented compact surfaces £j, at 
least one surface with boundary, joined at interior or boundary double points together with 
k a distinct marked points in the boundary (<9£) a , a = 1, • • • ,m, and I distinct interior 
marked points, none of which are double points. The £j, with their special points, are of 
two types: 

(1) stable components, and 

(2) unstable components, which are unstable sphere bubbles or unstable disc bubbles. 
And there must be at least one stable component. 

There exists a natural stablization map 

st : £ £ (2.1) 

that collapses the unstable components to points, thus we get a connected domain £ = 
st(£) which is a stable genus g open curve. 

Bordered bubble domains can be constructed from a stable bordered Riemann surface 
£o by replacing points by finite chains of 2-spheres or 2-discs or their combination. Al- 
ternatively, they can be obtained from a smooth Riemann surface £q by pinching a set 
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of nonintersecting embedded circles in the interior of So and (or) a set of half-circles in 
So with centers in the boundary <9So- The latter viewpoint can be formalized as follows. 
Assume that there are b a double points on each boundary component (<9S) a , a — 1, • • • , m, 
and there are d interior double points. Denote by b = (&i, • • • , b m ). 

Definition 2.5 A resolution of (go, m) -type (k, I) -marked bordered bubble domain S with 
(h,d)-double points is a smooth bordered Riemann surface with genus g, d embedded circles 
7 C in the interior part and b a embedded half-circles j a h with centers in each (<9So) a ? o, = 
1, • • • , m, (any two of distinct circles or half-circles are disjoint), and the (k, I) -marked 
points are apart from 7^ and j c , together with a resolution map 

S& : S -»• S 

which respects orientation and marked points, takes each'jc (resp. j a h) t° o- n interior (resp. 
boundary) double point of S, and restricts to a diffeomorphism from the complement of 
\}lah U 7 C in S to the complement of the double points, where 7ah (resp. %) denotes the 
closure of half- disc (resp. disc) contained by 7^ (resp. ^ c ). 

We next define (J, i/)-holomorphic maps from bubble domains. Such maps depend on 
the choice of an w-compatible (tamed) almost complex structure J and an inhomogeneous 
perturbation u to the Cauchy-Riemann equation. Let m, i = 1,2, denote the projection 
from Exlto the i th factor and let %' denote the restriction of 7Tj to <9S x L. We define 
the inhomogeneous term to be the section 

v G r(S x X, Hom(7r^TS, vr^TX)) 

such that 

(1) v is (js, J)-antidinear: v o j s = —Jo u; 

(2) H<9ExL carries a sub-bundle ir'^TdT, C 7r|TS to the sub-bundle 7r' 2 (JTX) C ir^TX. 
Denote by V the set of all such inhomogeneous terms. Let J denote the space of such 
pairs (J,v). 

Definition 2.6 A (J, u)-holomorphic open map from a bordered bubble domain curve 
(S,<9S) with complex structure js is a map 

u : (S,aS) -> (X,L) 

such that, on each component Sj of S, u is a smooth solution of the inhomogeneous 
Cauchy-Riemann equation 

dju = ^(du + J o du o jy) = i>(-, u(-)), (2.2) 

or equivalently, 

d(J,v)U = 

where dn tV \ denotes the perturbed nonlinear elliptic operator ^(d + J o d o — v. In 
particular, dju = on each unstable bubble. 



10 



Remark. It is not difficult to show that the operator d(j v \ gives rise to an elliptic boundary 
value problem. We refer to the Lemma 4.1 in |Soj . 



The symplectic area of the image is the number 

A{u) = [ oj = [ u*u (2.3) 

which depends only on the homology class of the curve modulo its boundary. And the 
energy of u is 

E(u) = \ ( \du\ 2 r u d» (2.4) 



2 . 

where | • \ ju is the norm defined by the metric on X determined by J and the metric // 
on the domain. For ( J, 0)-holomorphic maps, E(u) = A(u). 
We also define a modified energy E componentwise 



1 + 2 is \d u i\ 2 j ^[a, Ej is stable; 



E(ui) = { I r Y.T 2 Z ■ 7Z (2-5) 

I 3 Je P^lju^A*) ^» 1S unstable. 

And 

E(«) = J^E(iti). (2.6) 

Now we come to the definition of stable map 

Definition 2.7 ^4 (J,is)-holomorphic map u is stable if each of its component maps U{ = 
u\Y,i has positive modified energy i.e. E(ttj) > for each i. 

That is to say, either each component E, of the domain is a stable curve, or else the images 
of (Ej,9Ej) carries a nontrivial homology class. We have 

Lemma 2.1 Let (X,uj) be a compact symplectic manifold and L be a compact Lagrangian 
submanifold. Then 

(1) every (J,v)-holomorphic map has E(u) > 1. 

(2) There exists a constant h~ > such that for every component Ui of every stable 
(J,u)-holomorphic map u : (E,9E) — > (X,L) with Lagrangian boundary condition, we 
have 

E( Ui ) > h (2.7) 
Proof. (1) The conclusion is direct since at least one component is stable. 

(2) On the stable components, we have E(itj) > 1. On the unstable components, since 
Ui is a J-holomorphic map, the Proposition 4.1.4 of [McSj implies there exists h > 
depending only on (X, J) such that 

E(u.i) = E(ui) = - [ \dui\ 2 j dfj, > h, 
2 Jt,, 

provided the images of (Ej,(?Ej) carries a nontrivial homology class. Otherwise, if Ui 
represents a trivial homology class, then E(iij) = E(ui) = A(ui) = uj n [uj(Ej)] = 0, 
contrary the definition of stable map. □ 
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The following Gromov Convergence Theorem, which is also called Compactness The- 
orem, is the important fact about (J, z/)-holomorphic maps. It means that every sequence 
of (J, z/)-holomorphic maps from a smooth (bordered) domain has a subsequence which 
converges modulo automorphism to a stable map. Various forms of such convergence the- 
orem have been proved for closed curves (c.f. [G], [PWj . |RTlj . jYj, etc.). For open curves, 
we refer to [Liu], (McS] , 

Theorem 2.1 (Bubble Convergence). Let (X,u) be a compact symplectic manifold, 
L C X be a Lagrangian submanifold. Given any sequence {uj} of (k, I) -marked (Jj,Vj)- 
holomorphic maps from a bordered Riemann surface So satisfying Lagrangian boundary 
conditions, with K(uj) < Eq and (Jj,Uj) — > (J,v) in C k , k > 0, then we can obtain a 
subsequence and 

(1) a (k, I) -marked bordered bubble domain E with resolution SS : So — > E, and 

(2) automorphisms ipj of So preserving the orientation and the marked points, 
such that the modified subsequence {uj o ipj] converges to a limit 



where u is a stable (J,v)-holomorphic map. This convergence is in C°, and in C on 
compact sets not intersecting the collapsing curves 7^ and j c of the resolution M, and the 
area \2. 3\) and energy \2. 6\) are preserved in the limit. 

Given a bordered bubble domain curve with fixed complex structure (S,9S). Denote 
the space of equivalence classes of stable (k, Z)-marked open pseudoholomorphic maps with 
Lagrangian boundary conditions representing the homology class d by 

Ms,k t l(X,L,d) or simply M Kl (X,L,d). 

Definition 2.8 We say a map u : (E,<9E) — > (X,L) is multiply covered if there does not 
exist a point z £ S such that 

du(z)^0, and u(z) £ n(S \ {z}). 

A map is called irreducible or somewhere injective if it is not multiply covered. 

The multiply covered maps are often singular points in the moduli space Aiki(X,L,d). 
For keeping the paper in suitable length, we will essentially avoid dealing with these maps 
in the present paper, and the author plans to treat in another paper. 

Let Aik ; i(X, L, d)* be the space of irreducible stable open maps. The following theorem 
is direct from Theorem 12.11 and the index theorem (see [FOUOj |Liuj |Mc5] ) 

Theorem 2.2 (l)Ai^i(X, L, d) is compact and Hausdorff, and there exists evaluation 
map 

ev : M K i(X,L,d) — > X 1 x L^ (2.8) 

(2) For generic (J,^) £ J, M^^X, L,d)* is a manifold with boundary (corners) of 
dimension 

dim M Kl (X,L,d)* = n{d) + n(l - g) + k + 2l- dimvl^(E). (2.9) 

(3) For generic (J, v) £ J , ifMk,i(X, L, d) is irreducible, then the image of Aik^{X : L, d) 
under ev is a fundamental chain. 
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3 Some invariants for symplectic manifolds 



In this section, we show a rough description of the constructions of GW, relative GW 
and Open GW invariants. We will not repeat the detailed proofs since they can be found 
in references listed in the introduction part. 

3.1 Gromov-Witten invariants 

Let £ 9in be a compact Riemann surface of genus g with n marked points, (X, cj) be a 
closed symplectic manifold, we denote by J w the set of cj-tamed almost complex structures 
on X, and denote by J the set of all pairs ( J, u) with J G J^. For a second homology 
class A G H2(X), we denote by A4 g ^ n (X, A) the moduli space of (J, i/)-holomorphic curves 
u : S ff]n — > X representing A. Its Gromov compactification is denoted by Mg t n(X, A). For 
generic (J, u), Aig tTl (X, A) is a closed smooth manifold. If we denote the Deligne-Mumford 
compactification of the domain curves by M.g t m then we have a canonical projection 

vr : M g>n (X,A) ->M g , n , 

which is called "stabilization" defined by collapsing all unstable components of the domain 
curve. Moreover, we have canonical evaluation maps 

evi : Mg tn (X, A) -> X, evi(u) = u(xi), i = l,---,n, 

where X\ , * * * . Xfi £1X6 71 marked points on the domain. So we have a map 

vr x ev : M g>n (X, A) -> M g>n x X n . (3.1) 

If we assume that the moduli space has the expected dimensional, i.e. by index theorem 

dimM g , n (X, A) = 2 Cl (A) + (dimX - 6)(1 - g) + 2n, 

then the Gromov-Witten invariant is the homology class of the image of this map for 
generic (J,v). Or, in other words, if we choose differential forms and (3 such that 
[cti] G H*{X) and [/3] G H*(A4g, n ), then the genus g and n-marked Gromov-Witten 
invariant of (X, lo) is defined as the integral 

GW g , n ([ ai ), • • • , [a n ], [/3]) = [_ evl( ai ) A • • • A ev* n (a n ) A vr*(/3), (3.2) 

JMg,n(XA) 

which, by Stokes' Theorem, is independent of the choices of on and j3 and also independent 
of the generic choice of (J, u) since A4g tn (X, A) is a closed orbifold (The integral (|3.2p is 
defined to be zero unless dinxM gtn (X, A) = ^22=1 °- e S a i + P)- Therefore, GW g ^ n is an 
invariant of the deformation class of co parameterized by the cohomology classes [ai\ and 
f3. In some sense, we can regard the Gromov-Witten invariants of X as counting with 
sign the number of (J, ^)-holomorphic maps from a n-marked Riemann surface of fixed 
genus g to X representing the second homology class A and intersecting some fixed generic 
representative cycles of PD([ati\). And we use the class \j3\ to fix the conformal structure 
on the domain curve or the relative position of marked points. 

3 In general, the transversality is not always satisfied, the compactification of moduli space maybe have 
larger dimension than expected by index theorem. However, the compactification will carry a virtual cycle 
or virtual fundamental class which has the right dimension and, together with the map n x ev, can be used 
to define the GW invariants for general symplectic manifold. 
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3.2 Relative Gromov-Witten invariants 



Let us review the construction by Ionel-Parker of relative Gromov-Witten invariants 
for a symplectic manifold (X,u>) and a codimension 2 symplectic submanifold V. Such 
relative invariants can be used to describe how GW invariants behave under symplectic 
connect sums along V. A stable map into the connect sum can be regarded as a pair of 
stable maps into the two sides matching in the middle overlap region, so a sum formula 
requires a count of stable maps in X. Curves in X in general position will intersect the 
submanifold V in a finite collection of points. Then relative invariants will still be a count 
of these curves in X and will keep track of how the curves intersect V . 

To ensure that we can extend J and v to the connect sum we require to take some 
special and so-called V -compatible pair (J, v). Such a pair (J, v) is no longer generic. Note 
that co and J define a metric on X. Denote the orthogonal projection onto the normal 
bundle N v of V by ^ £ N . 

Definition 3.1 We say the pair {J,v) is V -compatible if its 1-jet along V satisfies the 
following three conditions: 

(1) J preserves TV and v N \v = 0; 
for all £ e N v , veTVandwe T£ 

(2) [(V C J + JV^J){v)] N = [(V„J)£ + J{V Jv m N ; 

(3) [(V e i/ + JVjtv)(w)] N = [(JV U{W) J)C] N , 
where V is the pullback connection on u*TX . 

We denote by J v the set of all ^-compatible pairs ( J, u) G J. The condition (1) in 
the Definition 13.11 ensures that V is a J-holomorphic submanifold, so (J, ^)-holomorphic 
curves in V are also ( J, z^)-holomorphic in X. From the Lemma 3.3 in |IPlj we know 
that conditions (2) and (3) ensure that for each (J, z/)-holomorphic map u whose image 
lies in V, the operator : F(u*Nv) — > Q 0,1 (u*Ny), by restricting the linearization of 
u = to the normal bundle, is a complex linear operator. 

Since the special pair (J, v) is not generic, the moduli space for such pair may have 
higher dimension. For instance, there exist such curves having some entire components 
completely lying in V which are badly nontransverse to V. We will exclude such maps 
and only choose V-regular maps to define the relative invariant. 

Definition 3.2 We say a stable {J,u)-holomorphic map into X is V-regular if no com- 
ponent and none of special points of its domain is mapped entirely into V . 

The ^/-regular maps (maybe with nodal domain) form an open subset of the set of 
stable maps, we denote the moduli space of V-regular maps ^yM^ n (X,A). Ionel-Parker 
showed that for each F-regular map u, the inverse image consists of isolated points 

Pi on the domain distinct from the special points. Furthermore, each pi has a well-defined 
multiplicity equal to the order of contact of the image of u with V at pi. We suppose 
there are altogether I intersection points. Then we denote all multiplicities by a vector 
s = (si, • • • , si) with each integer Si > 1. We define the degree, length and order of s by 

deg(s) = ^Sj, £(s) = £, \s\ = s 1 s 2 ■ ■ ■ s e . 

Each vector s labels one component of A4^ n (X, A) with deg(s) = A ■ V: 

Ml nj3 (X,A)cM g>n+i(s) (X,A). 



14 



From the Lemma 4.2 in |IPlj we know that for generic compatible pair (J,v), the irre- 
ducible part of M^ iU S (X, A) is a manifold with 

dim M^^X, A) = 2ci(A) + (dimX - 6)(1 - g) + 2(n + £(s) - deg(s)). (3.3) 

The next step is to construct a space that records the points where a ^-regular map 
intersects V and records the homology class of the map. In order to define a relative 
invariant useful for a connect sum gluing theorem, we should record the homology class 
of the curve in X \ V rather than in X. According to [IPlj . two elements of HiiX \ V) 
represent the same element of H2(X) if they differ by an element of the set of rim tori 
TZ C H2 (X \V). So the suitable homology- intersection data form a covering space T-CC of 
H 2 (X) x V 1 with fiber K. 

To obtain a "relative virtual class" that enable us to define the relative GW invariant, 
we construct a compactification of each component of ^-regular moduli space. Since we 
can think that there are n + £{s) marked points on the domain, we take the closure of 
JVVg n s {X,A) in the space of stable maps M. g ^ n+e ^(X, A), denote it by CM^ n s {X, A). 
Actually, the closure lies in the subset of M. g ^ n+ £( s \ (X, A) consisting of stable maps whose 
last £(s) marked points are mapped into V with associated multiplicities Sj. 

Ionel-Parker analysed the structure of the closure CJvC£ n S {X, A) and showed that the 
closure contains strata corresponding to three different fundamental types of limits: 

i) . stable maps with no components or special points lying entirely in V; 

ii) . a stable with smooth domain which is mapped entirely into V; 

iii) . maps with some components in V and some off V. 

From the Proposition 6.1 in |IPlj we know that for generic pair (J, u) £ J v , each 
stratum of the irreducible part of 

CMl n>s (X,A)\Ml n>s (X,A) 

is a manifold of dimension at least two less than the dimension of M^ n s {X,A). 

To prove their Proposition 6.1, Ionel-Parker study the sequences u n of ^-regular maps 
by an iterated renormalization procedure and show that each such sequence limits to a 
stable map u with additional structure. The key point is that if some of components of 
such limit maps have images lying in V, then along each component in V there is a section 
£ of the normal bundle of V satisfying an elliptic equation D N ^ = 0. The £ records the 
direction from which the image of that component came as it approached V. They call the 
stable maps with this additional structure V-stable maps, denoted by A4 gn s (X, A). Thus 

n s (X } A) compactifies the space of ^/-regular maps M^ n s (X, A) by adding frontier 
strata of codimension at least two. 

Now we have a canonical map which can be regarded as the definition of relative 
Gromov-Witten invariants similar to the way that the GW invariants are defined in (|3.ip 

e v : Ml n>s (X, A) — > M g>n+i(s) xX n xH^, (3.4) 

where the last factor controls how the images of the maps intersect V. Then Theorem 8.1 
in [IPlj showed that for generic (J,v) £ J , the image oi A4 g n s (X, A) under ey defines 
a homology class 

GWx,A, g>n ,s e H*(M g!n+e(s) x X n x U v x -Q) 
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of dimension as expressed in (|5.ip . Also this homology class is independent of the generic 
choice of the pair (J, u) G J v and depends only on the symplectic deformation equivalence 
class of (X,V,oj). Here we say (X, V,uj) is deformation equivalent to (X' ,V' ,uj') if there 
is a diffeomorphism <fi : X' — > X such that (X' , lo) is isotopic to (X', V', a/). 

Geometrically, relative GW invariants count with sign the number of F-stable maps 
with constraints on the complex structure of the domain, the images of marked points, 
and the way of the intersection with V. To see that, we can evaluate the homology 
class GWx Agns on dual cohomology class. Choose k G H*{M g ^ n+ ^), a vector a = 
(ai, • • • ,a n ) of classes in H*(X), and 7 G H*{%Y C ) satisfying 

dim M^ n S (X, A) = deg k + deg a + deg 7. 

Then the evaluation pairing reexpresses the invariant as a collection of numbers 

GW^ tAg ^ s {K,a,-/) = ([G^ iiW ],/tUaU7), 

3.3 Open GW invariants for (X,u,4>) of lower dimensions 

Let us first introduce some notations used in [So]. We denote by (X,u>) a symplectic 
manifold of dimension 2n and by L C X a Lagrangian submanifold. Let denote the 
set of cj-tame almost complex structures on X, and let J G J u . Let denote the set of 
J-anti-linear inhomogeneous perturbation terms generalizing those introduced by Ruan 
and Tian in |RTlj . and let v G V. Denote a Riemann surface with boundary by (£,e)£), 
we will fix a conformal structure j on £ through this paper. Suppose <9X = U^Li(<9£) a , 
where each (<9E) a ~ 5 1 . Let 

d=(d J d lj -.. ,d m ) Glf 2 (X,L)©#i(L)® m , 

and k = (Jfei, • • • , /c m ) G N m U {0, • • • , 0}, / G N U {0}. Then we denote by 

^k,/(S,L,d) 

the moduli space of ( J, ^)-holomorphic maps u : (£,3£) — > (X,L) with k a marked points 
Z\, ■ ■ ■ , Zk a on (<9£) a and / marked points wi, • • ■ , Wi on £ such that u*([£, $£]) = d and 
ii|(gs) B *([(<9S) a ]) = d a . Its Gromov compactification is denoted by M^iiT,, L, d). We have 
the evaluation maps 

evb ai : A^ k>i (E, L, d) ->■ L, i = 1, ■ ■ ■ , k a , a = 1, • • • ,m, 

evij : M-k,i(E,L,d) ->• X, j = 1, 

In fact, the moduli space above can be considered as the zero locus of a Fredholm 
section of a Banach bundle. We denote by £? 1,p (£,L,d) the Banach manifold of W 1,p 
maps u : (£, dY,) — > (X,L) such that u*([£, = d and it|(a£) o *([(c?£) a ]) = ^o- Ami 
define 

B#(E, L, d) := B^(E, L, d) x [1(3* x \ A, 

a 
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where A denotes the subset of the product in which two marked points coincide. Elements 
of B^(T,, L, d) are denoted by u = (u,z,w), where z = (z a i) and (w) = (wj). The 
evaluation maps can also be similarly defined on this larger space 

evb a i : S k 'J(S,L,d) ->■ L, i = 1, • • • , k a , a = 1, • • • , m, 

evi i : S kJ ( S > L ' d ) X ' J = !,•••, ^ 
eu& ai (u) = u(z a i), evij(u) = u(wj). 

The total evaluation map is denoted by 

ev := ]Jevb a i x \\evij : Bjj(E,L,d) -> L |k| x X*. 

Then the Banach space bundle £ — > B k '?(E, L, d) is defined fiberwise with 

£ u :=L p ('E,n ' 1 (u*TX)). 

We define the section of this bundle as 

B m :Bjj(£,L,d)->£ 

which is the ^-perturbed Cauchy-Riemann operator (see section 4 in |Soj ) . The vertical 
component of the linearization of this section is denoted by 

D:= Dd {Jjl/ y.TB^,L,d)^£. 

The parameterized moduli space is the zero locus of the section d^j^ which is denoted by 

M Kl (Z,L,d) := ffjj(0) C B k 'J(S,L,d). 

We follow [So] to define our moduli space .Mk,z(E, L, d) C .M ki (£,L,d) as an appro- 
priate section (or say slice) of the reparameterization group action, we refer the reader to 
the section 4 in |Soj for details of construction. 

Then let 

£ := det(D) -> B k 'J(S,L,d) 

be the determinant line bundle of the family of Fredholm operators D. 

According to the Proposition 3.1 in jSoj . if the Lagrangian submanifold L admits a 
(relative) Pin^ structure, then there exists a canonical isomorphism of line bundles 

C ^-(g)evb* ai det(TL). 

a,i 

Let us then suppose there exists an anti-symplectic involution <fi such that L = Fix(0). 
And suppose S is biholomorphic to its conjugation S, i.e. there exists an anti-holomorphic 
involution c : £ — > S. Define 
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Fix J G J u ,<j>i define V^^ to be the set of v € V satisfying dcj) o u o dc = v, then take 
v £ V&c- Thus, from the ( J, z>)-holomorphic map u : (E,(9S) i— )• (X, L) we can define its 
conjugate (J, z^)-holomorphic map u = <j) o u o c representing the homology class <i = [u]. 
So we have an induced map 

0':B^(E,L,d)-^sJj(S,L,d) 

given by 

u = (ti, z, tZJ) i— >• u = (tt, (c|as)' k 'z, c'ro). 
We denote the relevant Banach space bundle by £ -»• B^f (£, L, d) with fiber 

And we can similarly get a determinant line bundle of a family of Fredholm operators 
D : TB£j(£, L, d) ^£ as 

£ := det(5) -> flJj(S,L,d). 
The evaluation maps can also be similarly defined as 

evb a i : B^J(E,L,d) -> L, i = 1, ■ ■ ■ , fc a , a = 1, ■ ■ ■ , m, 

evij : B^(E,L,d) X, J = 1, • • • , Z, 
evb ai (u) = u(c(z a i)), evij(u) = u(c(wj)). 
The total evaluation map is denoted by 

ev := Yl evb a i x JJ eui^ : B£j(E, L, d) -> L |k| x X*. 
Moreover, we can define a map 

^ h^- d(p o ^ o dc 

covering <fi' '. Also <P induces a map VP : £ — )• £ covering </>'. We still follow |So| denote 
£' := Hom(0 evb* ai det{T L) , £) ~ £ ® (g) ev^det(TL)* 

£' := Hom(0 ei)6*idet(TL), £) ~ £ (g) evb* ai det(TL)* . 

a,i a,i 

Thus, VP also induces a map VP' between £' and £' covering (f)'. 

From the Proposition 3.1 and Definition 3.2 in jSoj we know that both £' and £' have 
canonical orientation. So the map VP' may either preserve the orientation component or 
reverse the orientation of some connected components. We say the sign of VP' is if VP' 
preserves the orientation of £' to that of £', otherwise, we say the sign of VP' is 1. 
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Now we have two moduli spaces M.^ L, d) and, corresponding to the anti-symplectic 
involution <f>, A4kj(E, L, d). And we can restrict the two total evaluation maps 

ev : M kj i(£,L,d) ->• L |k| x X 1 , 

ev : .M kj j(E,L,d) -> x jf'. 

For generic choice of points x = (x a i), x a i G L, and pairs of points y + = (yt), y~ = {yj) 
such that ■jjj' = <p(y~), j = 1, • • • ,1, the two total evaluation maps will be transverse to 

a,i j o,i j 

in L' k ' x X', respectively. The index theorem for D implies the following dimension 
condition 

(n - l)(|k| + 21) = n(l -g) + n(d) - dim Aut(L), (3.5) 

where fi : H^iX^L) — > Z denote the Maslov index, g denote the genus of the closed 
Riemann surface £ Ugs E obtained by doubling E. Note that /i(<i) = we can define 
a number as 

M(d,0,k,O = #ev- 1 (x,y + ) + #SV- 1 (x,y„), (3.6) 

where # denotes the signed count with the sign of a given point, for example u G 
ev _1 (f, y+), depending on whether or not the isomorphism 

dev u : det(™ kj/ (S,L,d)) u => ev*det(T(L |k| x X l )) u 

agrees with the underlying canonical isomorphism appearing in the Theorem 1.1 in jSoj 

det(TM k ,i(E, L, d))=+ (g) evb* ai det(TL). 

a.i 

In particular, if d = d we just define the same number as the one defined by Solomon 

M(d,0,k,/) = 2V SjdW = #ev~ 1 (f,y), 

where (cc, y) is a real configuration, i.e. I = 2c, y = {yf,--- ',- •• satisfying 

?/i = 4>{y^), i = 1, • • • , c. For such special d G H2(X, L), Solomon [So] proved that A^s,d,k,z 
are invariants if L is orientable and dimL = 3 or if L may not orientable and dimL = 2. 
However, for general homology class d, we might not expect that M(d, 0, k, /) is invariant. 

In order to define enumerative invariant not only for restricted homology class d, let 
us introduce more necessary notations. We denote by d = dc the doubling of d. For any 
homology class j3 G if 2 (X, L) , denote 

= OMi.- •• ,/3 m )Gif 2 (X,L)©iIi(L)® m , 

and we denote the set of (k, Z)-real configurations by 

= ) = {xn,--- , Xmkm, ■ = y] or ^ = yr,j = !,-•• ,/}. 
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Moreover, denote by ev^^ the evaluation map 

ev (A0 :M Kl (X,Lj)^LM xX l , 

(u, z, w) i— > (x = u(z),{; = u(w)). 
Now, we can define one number 

/(d,0,k,Z):= ]T #ev^(f,e) (3.7) 

V/3:/3 c =d;Vre^(x,j7) 

In the sequel, we will show that the number I(d, (f>, k, Z) is an invariant, provided L is 
orientable and dimL = 3. 

Remark. The definition of invariants (|3.7|) is a generalization of the one by Cho [C] to 
higher genus case. 

Before proving the invariance, we rewrite the number I(d, eft, k, I) as a sum of some 
integrals. Let f2*(L, det(TL)) denote differential forms on L with values in det(TL), 
and let £l*(X) denote ordinary differential forms on X. Let a a i S f2 n (L, det(TL)), a = 
1, • • • ,m;i = 1, • • • ,fc a , represent the Poincare dual of the point x a i in H n (L,det(TL)), 
which is the cohomology of L with coefficients in the flat line bundle det (TL). And let 
7j £ 2n (X) represent the Poincare dual of £j for j = 1, • • • , Z. Then it is obvious that we 
have the following expression 

7(d,0,k,O= ^2 I— _ evb* n { ail ) A ■ ■ ■ A evi^i (3.8) 

To show that the definition (|3.7p is independent of the choices of points x and pairs of 
points (y+,y_) is equivalent to proving the expression (|3.8p is independent of the choices 
of det(TL)-valued n-forms a a i and pairs of 2n-forms (n'jilj)-i where 7^ represent the 
Poincare dual of for j = 1, ■ ■ ■ , /. 

• Proof of invariance 

Here, for simply showing the main idea of the method, we only give a sketchy proof 
of the invariance for a special case, with respect to general homology class d S H2(X). A 
complete proof for the special homology class d = d is given in [So]. Assume that dimL = 3 
and L is orientable. We will show that the definition of I(d, (j>, k, I) does not depend on 
the choice of points x = (x a i), x a i £ L, and pairs of points y+ = (yf)i V- — (vj)- Suppose 
that we are given different points x' and y'± satisfying the same generic conditions. 

Let us denote 

x : [0, 1] ->■ x(0) = f, x(l)=a?, 

y ± :[0,l]-^^', y + (t) = 0(y-(t)), 
y ± (0) = y±, y ± (l) = y' ± , 
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E:[0,l]^X l , H(0)=£, E(l)=£', 

moreover, we require that £j = (or yj) if and only if = (or y'~)- Denote the set 
of all paths by 

R:=R(x,y ± ) = {(x,H)} 

And denote 

W(x,~,/3) :=M k ,i(X,Lj) eViM x (xxS)oA ([0,1]), 
W:=W(x,y ± ,a) := \J W(x,H,/3). 

(x,s)eR 

Note that W gives a smooth oriented cobordism between 

U and U ev ^^- 

V/3:^c=d;Vre^(x,y) V/3:/3 c =d;Vr'g7^(x',i/) 

Since in general W is noncompact, in order to prove the invariance of /(<d, <j>, k, Z), we 
must research the stable boundary c^W arising from the Gromov compactification of W. 
We still adopt the notations in [So]. Denote by 



B * = B^J^LJ',?") := B^ +ea ,(X,Lj>) evb , o x evb ,, B^ +1V ,{D 2 , L, ft') 

the space of W 1,p stable maps with only one disc bubbling off the boundary component 
(dYi)b along with k" of the marked points on ((?£);> and I" of the interior marked points, 
representing the class ft' £ H 2 (X,L), where ft = (/?', - - - ,ft b ,-" ,Pm) £ H 2 {X,L) © 
#i(L)® m , satisfying /3' + ft' = p, ft b + 0/3" = ft, and 

k' + e 6 = (fci, • • • , A% + 1, • • ■ , fcm), 

cr C [1, kb], Q C [1, Z] denote the subsets of boundary and interior bubble off marked points, 
respectively. 

We write the element u G B^^T,, L, ft, ft') as u = (u',u"), where 



such that 

e*4(u') = eu&g(u"). 

Similarly, we have the Banach space bundle — > B#, the section $fj v \ '■ — > 
the operator D# : TB# — y £#, the moduli space M^aj^CE, L, ft , ft'), the determinant 
line bundle := det(D#) and 

£#' = £# £?) ew 6*.det(TL)*. 



Since there exists a standard conjugation c : D 2 — > D 2 , the anti-symplectic involution 
on X induces a map 

<P# : B* = B l ^ Q {E,L,ft,ft') -> B& Afl (E,L,^ = B#. 
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u= (u',u") = [u',(u",z",w")} ^u=(u',u") = [u',(u", (c^f'+'z", c l "w")\. 
Similarly, we have maps 

£# 

covering 0*. 

We can generically choose (x, y^) such that (x, H) = [x, (H^E")] G R is transverse to 
the total evaluation map 

ev (MV1 : M k , a ,i, e (Z,Lj',p") -> L' k ' x X 1 , . 

We denote by 

<9g1 / 1 ; (t ^ / 3 =/ 3/ +/ 3» (H") := M]c^ e (^,L,P',P' )ev (j8 , +j8 // ijS) X(xx(H',3"))oA [0,1], 
the boundary stratum of the cobordism W arising from Gromov compactification. And 

oe[l,m],<rc[l,4 (J? + p») c = d 

gC[l,l] 

So we have an induced involution map on the boundary of cobordism 

Using the similar arguments as in jSoj . we can show that this map is fixed point free. We 
below will show that it is orientation reversing if L is orientable and dimL = 3. 

Recall that, under our assumptions, the formula (19) in [So] expressing the sign of 
still works. And it can be simplified as 

sign^*') = ^p- + k" + 1 + 1" mod 2, (3.9) 

since u>2 = as L admits Pin structure. And similar to Solomon's arguments, the map 

4>* ■ Mic^p, L, p>, 0") -> M kW ,,(S, L, p>, f>) 

has the same sign. Since dimL = 3, we see that the involution r/> acts on X reversing the 
orientation since 4>*uj 3 = —ui 3 . So <j> acts non-trivially on I" of the factors of X 1 . Therefore, 
the sign of the map between the two fiber products 

should be independent of I". 
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Note that each set ddW a e & p" is nonempty if and only if the following dimension 
condition is satisfied 

fi(P") = 2k" + Al". (3.10) 

Thus we have 

u(8") 

sign((p d ) = t-^-± + A;" + 1 = 1 mod 2. 

That is to say, the map (j)g reverses orientation. That means ^<9gW = 0. Therefore, we 
have 

= #dW = E^, #ev^ ?) 0?, i> ) - # ev ^r) & e ) + #^gW 

= /'(d,0,M L /(d,0,M. 

So integers /(d, 0, k, /) are independent of the choice of (x,y±). Equivalently, we can say 
that the integral in (|3.8p is independent of the choices of a a i and jj. Similarly, we can 
prove that /(d, 4>, k, I) are independent of the generic choice of J € Ju>,<j>, and the choice of 
inhomogeneous perturbation v 6 Va,,c- That means /(d, <j), k, i) are invariants of the triple 

(x,u,4>). 



4 F-compatible pair (J, z/) 

We now come to extend Solomon's open symplectic invariants -/Vs,d,k,i with d = d (or in 
general our J(d, k, Z)) expressed in subsection 13 . 31 to open invariants of (X, uj, 4>) relative 
to a codimension 2 symplectic submanifold V such that 4>\y is also an anti-symplectic 
involution on (V, uj\y). Recall the assumption that L = Fix(0) ^ is a Lagrangian 
submanifold. Note that V n L might be empty set. If V fl L = Fix(^|y) / 0, then we 
denote by Ly = V D L which is a Lagrangian submanifold of (V, oo\y). We consider open 
curves generically intersect V in a finite collection of points. Such relative open invariants 
will count these open curves satisfying some constraints. In particular, if L n V = 0, we 
will not encounter extra codimension 1 boundary of moduli space except the moduli space 
of pseudoholomorphic maps with a bubble disc. If dim L < 3, under some assumptions, we 
will define relatively open invariants for domain curves of any genus with fixed conformal 
structures. 

Let us reset our notations for new discussion. Suppose dimX = 2n. We denote still 
by (£, dYi) the domain Riemann surface with m boundary components and with fixed 
conformal structure j's. That means we also don't deal with the case that the degener- 
ations of S may occur. Denote by g the genus of the closed Riemann surface X Ugs ^ 
obtained by doubling S. If X is a closed Riemann surface then g is just the genus of 
itself. Assume that there are k a distinct marked points {z a i,--- ^z^^ on the bound- 
ary component (<9£) a , a = 1, • • • ,m, and / distinct interior marked points {w\, ■ ■ ■ ,wi}. 
Denote by k = (ki, ■ ■ ■ ,k m ). Additionally, we assume that there are k a marked points 
{Pair" )Pak } on each boundary component (9S) a , a = 1, ••• ,m, which are different 
from {z a i, ■ ■ ■ , z a k a } and are mapped to the intersection points of V and the image of our 
open curve u : (£, dH) — > (X, L) if V fl L ^ 0. Denote by k = (ki, • • • , k m ). Also, we as- 
sume there are 1 interior marked points {qi, • • • , q{\ which are different from {w\, • • • , w{\ 
and are mapped to the intersection points of V and the image of u. For given homol- 
ogy class d = (d,d\,--- ,d m ) G H2(X,L) © Hi(L)® m , and given a pair {J,v), denoted 
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by -A4k,z,k,i(^) L, d) the moduli space of (k, I, k, l)-marked (J, u) pseudoholomorphic maps 
such that u*([E, <9£]) = d and u\(g-£) a *([(dY,) a ]) = d a , i.e. representing d, which is the zero 
set of 

®{J,v) u = dju — v = -(du + J o du o js) — v. (4-1) 
We denote the ambient space, which is the Sobolev completion of M.^i t \j(X, L, d), by 

B^ K1 (X,L,d) := B l *(X,L,d) x H(dZ)^ +l ^ x S^A, 

a 

where B 1,P (X, L,d) denote the Banach manifold of W 1,p maps u : (X,(9£) — > (X,L) 
representing d. If we use vectors z = (z a i),w = (wj),p = (p a t),Q = (Qj) to denote marked 
points respectively, then we denote elements of B^ P kl (X, L,d) by u = (u, z,w,p, q). We 
simply denote the restricted pullback bundle (u\qy,)*TL by u*TL. By straightforward 
computations we have the following proposition. 

Proposition 4.1 The linearization of at u € Mk.,i,h.,i(X, L, d) is 

D u := D U B {J)V) : r[(£,dX),(u*TX,u*TL)] Q ' 1 ^, u*TX) 

Du{0 = ^[V£ + JoVZoj + V^Joduoj] 

+\[T{i, du) + JT(£, o j)] - (4.2) 

where V is i/ie pullbacked connection on u*TX and T((, n) = V^rj — V v ( — [£, rj\ is the 
torsion of V. 

Denote by 

T>u{£) = ^ [Vf + J o V£ o j + V 5 J o du o j] - V^za (4.3) 
We can similarly define the Banach space bundle £ — > -B^ fk lO^' ^> d) fiberwise by 

£ u := LP^Q^^TX)). 

So we still think 

d(J,u)--B l ^ Kl (X,L,d)^£ 
as a section of £. And we also denote by 

D:=Dd { j !U y.TB^ p lxl (X,L,d)^£ 

the vertical component of the linearization of d^j^y From the Proposition 6.14 in |Liuj 
we know that for each u £ -B^Ti? i(AT, L, d), both D u and T> u are Fredholm operators with 
the same index ind(D u ) = ind(2? M ) = /i + n(l — 5), where /i = /-i(u*TX, u*TL) is the total 
boundary Maslov index associated with the vector bundle pair (u*TX, u*TL) defined in 
the Appendix. In particular, if u is a (J, i/)-holomorphic map with closed genus g domain 
curve, then ind(Z? u ) = ind(2\) = 2c\ + 2n(l — g), where c\ is the first Chern number of 
the bundle m*TI -> E. 
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Also we suppose E is biholomorphic to its conjugation E, i.e. there exists an anti- 
holomorphic involution c : E — > E. Now for each J G ,JL;,</>i we denote by "P^ c the set of 
v £ V satisfying d(j) o u o dc = v. Denote 

J'.= {(J,v)\J eJ m veV}> 

J := {(J, v)\ J G J"^, 1/ G p£ c } C J. 

We still assume L is relatively Pin^ and fix a relative Pin ± structure ^3 on L. If L is 
orientable, we fix an orientation on L. 

Denote the orthogonal projection onto the normal bundle Ny by £ i— > ^ N . Since Ly, if 
nonempty, is a submanifold of L, we denote the normal bundle of Ly in L by iVz, v . Then 
for each (J, i/)-holomorphic open map u whose image lies in (V, Ly), the operator 

D% : r[(E, aE), (u*N v , u*N Lv )] ^ ^(S, u*iVy), 

Itf(0 = [A,(0]" (4-4) 

by restricting the vertical linearization of d(j t v) at u to the normal bundle, is also a real 
linear Fredholm operator. 

Similar to the construction of relative GW invariants, we will restrict attention to a 
subspace I v C J (jY C involving the involution ) consisting of pairs (J, z/) that are 
compatible with V in the following sense. 

Definition 4.1 We say the pair (J, v) G J is V -compatible if the following three condi- 
tions hold: 



(1) J preserves TV and u \y = 0/ 
for all £ G (Ny,N Lv ), v £ TV and $ £ TE 

fi?J [(V 5 J + JV JC ./)(«)]" = [(JVj„ J)£ + (V, J)^; 

W [(JV, W J)^ = [(V^ + JVjtv)(0)] N . 

We denote by $ v (resp. J^") the set of all V-compatible pairs (J, u) G J (resp. (J, i/) G J^). 
The condition (1) in the Definition 14. 1 1 ensures that V is a J-holomorphic submanifold, and 
that (J, z/)-holomorphic curves in (V, Ly = VOL), if VOL ^ 0, are also (J, z^)-holomorphic 
in (X, L). Conditions (2) and (3) ensure that for each (J, z^)-holomorphic map with closed 
domain curve whose image lies in V 

u : E -»• V, 

the operator 

2^: r[(S,n*iVy)^^ 1 (E, U *7Vy), 

P?(0 = (4-5) 

by restricting the linearization of dtj iU ) at u to the normal bundle, is a complex linear 
operator. The following lemma is taken from |IPlj . 
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Lemma 4.1 Choose (J,u) € I v (resp. $^)- Then for each {J, u) -holomorphic map u 
from closed domain curve whose image lies in V , the operator T>^ is a complex operator. 

Proof. It is enough to show that the operator commutes with J. We just need verify that 
for each £ E Ny, [T>( </£) — JT>(t;)] N = 0, since J preserves TV and so preserves the normal 
bundle. Note that 

= + J o + V 5 J o o (jtf)] - V c i/(0). 

Consider 

2J[V{J£) - J2>(£)](0) = (JV* J)i - (V il? J)£ + (V s J + JV JC J) o du o (jtf) 

-2[V^ + JVj^O?)- 

Let v = du o (ji?) G TV. Note that V,$J = VduotiJ- Substituting the formula du o $ = 
2zv(#) — J o du o j"d into the first term and taking the normal component, we see 

2J[V(J0 - JV(0] N ($) = 2[(JV m J)£ - (V^ + JVjtu)(#)] N 

+ [(V ? J + JV J£ J)(v)] N - [(JV Jv J)£ + (V V J)£] N , 

then the conditions (2) and (3) in the Definition 14.11 ensure that the sum is zero. So T>^ 
is a complex operator. □ 



In the following we will not distinguish D and T> and denote always by D the lineariza- 
tion operator. In the end of the section, we show a local normal form for open holomorphic 
maps near the points where they intersect V. Here the argument is similar to the Lemma 
3.4 in flPl] . 

Take a pair ( J, v) satisfying the condition (1) in the Definition 14.11 Let V be a codi- 
mension two J-holomorphic submanifold of A, and u : — > (A, L) be a (J,v)- 
holomorphic map which intersects V. Suppose Ly = VOL ^ 0. Take a boundary 
marked point p ai G (dT,) a and a interior marked point q 3 satisfying p = u(p at ) G Ly and 
q = u(qj) G V. Let H = {z = x + iy\ y > 0} be the upper half complex plane. Fix a 
local holomorphic coordinate z G H on a half open disc S in E containing p aj or a local 
holomorphic coordinate on an open disc O in £ containing qy Also fix local coordinates 
{v 1 } = {v n ,v 12 } (1 < i\ < n — 1, n < ^2 < 2n — 2) in an open set i n V such that {t> n } 
are the local coordinates in the open set Gy n Ly in Ly. And we extend {v 1 } to local 
coordinates {v 1 , x} for A with x = along V and so that x = x 1 + ix 2 with J(-^r) = 
and J(-£^) = — moreover, we require that {f 11 ,^ 1 } are just local coordinates for L. 

Lemma 4.2 (normal form). Suppose that Y, is a smooth connected Riemann surface with 
boundary and u is a (J, v) -holomorphic map which intersects V at p or q. Then either 
(1) C V, or (2) there exist an integer K > and a nonzero ao G C suc/i i/iai near 
interior intersection point 

u(z,z) = (tf + 0(\z\), a z K + 0(\z\ K+1 )), (4.6) 

or near boundary intersection point 

u(z, z) = (p* + O(N), a z K + 0(\z\ K+1 )), (4.7) 
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in the local coordinates z and {v l ,x}, respectively, where 0(\z\ k ) denotes a function of 
z and z that vanished to order k at z = 0. In particular, writing z = r + y— T s and 
restricting 7[ ) to the real part, we have 

u(z, z)\ R = u{r) = (p* + 0(\r\), c r K + 0(\r\ K+1 )), (4.8) 

in the local coordinates {v i:L ,x } in L, where Co is a nonzero real number. 

Proof. Let Jo be the standard complex structure in the coordinates (v l ,x a ). Since J is 
close to Jq, we can set 



A= (I - J J) _1 (/ + Jo J) and i> = 2(1- J Jo)" 1 



v. 



Then it is not hard to verify that the (J, i/)-holomorphic map equation dju = v is equiv- 
alent to 

B Jo u = Ad Jo u + v. (4.9) 
Note that the components of the matrix of J satisfy 

(J — Jo)j = 0(\v\ + \x\), (J- J )1 = O(\x\), (J — Jo)a = 0(\x\). (4.10) 

So we have 

A) = 0{\v\ + \x\), A% = 0(\x\), Ai = 0(\x\), and i/ a = 0(\x\) 

since the normal component of v vanishes along V. We express u = (v l (z,z),x a (z,z)). 
Because A l a vanishes along V and dv l and are bounded near p ai or q 3 we get 

(94* (94* 

Also we have < C(|x| + \dx\). Now we analyse the equation (|4.9p . for the x compo- 
nents of u we have 

B Jo x a = Afdj^ + Ap Jo x? + z> Q , (4.11) 

thus 

dj B Jo x a = dj Afd Jo v l + Afdjy + d Jo Ap Jo x^ + A^ a^ + dj v a . 

We have 

|Ax a | 2 = \U Jo Bj x a \ 2 < C(\x\ 2 + |d Jo x| 2 ). 

By Aronszajn's unique continuation theorem, if x a vanishes to infinite order at p ai or q 3 
then x a = in a neighborhood of p ai or qy That is to say, ii(X) C V locally. In fact, this 
conclusion is independent of coordinates, so we know ii(X) C V . Otherwise, if the order 
K of vanishing is finite, then we can expand x a (z,z) into Taylor series with beginning 
term Ylk=o^ k 'z K ~ k . So x is Od^l^), then from (|4.1ip we have 

B Jo x a = 0(\x\) = 0(\z\ K ). 

But if the factor z appears in the order d item of Taylor expansion of x a (z, z), Bj x a should 
be 0(|z|^ _1 ). That is, we only have leading term qqz k . So we get (|4.6p and (|4.7p . □ 
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5 Moduli space of V-regular open stable maps 



Definition 5.1 Given a codimension two symplectic submanifold V of (X,lj). A stable 
(J,i>)-holomorphic map u : (£,<?£) — > (X,L) is called ^-regular if no component of its 
domain is mapped entirely into V and if neither any marked point nor any double point is 
mapped into V . 

The set of F-regular maps forms an open subset of the space of stable maps, denote it 
by M v (X, L, d). Denote by M% lhl (X,L,d) the space of ^/-regular maps with marked 
points. 

We denote by 

r = (ru,--- ,nki,?"2i, • • • ,r m i,"- ,r m h m ), s = (si,-- - ,si) 

the list of multiplicities of boundary and interior intersection points, respectively, where 
r a i and Sj are positive integer numbers. And we define the degree, length, and order of r 
and s by 

m k a m m k a 

deg r := ^2 ^2 rail len g tn ( lr ) : = K = ka ' ord ( Ir ) := kl = I I r au 
a=l i=l a=l a=l i=l 

deg $ := Sj, length(s) :=£ = !, ord(s) := |s| = sj. 

The pair of vectors (r, s) labels the component of MXlI k ^' We denote each (r, s)- 
labeled component of .M^ ; k t (X, L, d) by 

M%ih(X,L,d) C X k+M+1 (X,L,d), 

where k + k denotes the vector of numbers of boundary marked points {k\ + ki, • • • , k m + 
k m ). Forgetting the additional k + 1 marked points defines a projection 

I (5.1) 
Ml t (X,L,d) 

onto one component of JvO^AX, L, d), which is the disjoint union of such components. So 
for each fixed pair (r, s), (|5.1|) is a covering map to its image whose deck transformation 
group is the direct product of all groups of renumberings of the k a marked points on each 
boundary (9S) a and the group of renumberings of the 1 = £ interior marked points. 
We define the universal moduli space 

UM Kl = UM K i(X, L, d) := {(u, (J, v)) | (J, v) 6 J,u£ M Kl (X, L, d)} 

consists of all (J, z^)-holomorphic maps representing d, where (J, v) varies over the space 
X The irreducible part of the universal moduli space involving the intersection data is 
denoted by UM*^i £f. Note that is also the zero set of the equation (|4.ip . We 

write the map by 

<&(u, J, v) = Bju — v = -(du + J o du o — v. (5-2) 
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Lemma 5.1 For generic (J, v) S the irreducible 'part ofMyjJt AX, L, d) is a manifold 
with boundary of dimension 

dim M^/X, L, d) = n(d) +n(l-g) + (k + K- deg r) 

+2(/ + £-deg s) -dimAut(£). (5.3) 

Proof. It is a modification of the arguments used in the Lemma 4.2 and Lemma 4.3 of |IPlj . 
If we show that the irreducible part of universal moduli space UAi*^ is a manifold, 
then the Sard-Smale transversality theorem and implicit function theorem imply that for 
generic ( J, v) € S v the irreducible part of the F-regular moduli space is a manifold of the 
dimension f)5.3[) . 

Let 9Jtj^ ; denote the space of tuples (u, J, v, z, w), where (u, z, w) S B^(X, L, d), with 
u being taken to be 1^-regular and irreducible, and (J, v) G 3 V . The map Bj :U is defined on 
2Jt^ ; . We can apply the standard argument to show that the linearization Ddj :l/ is onto at 
the zeros set (see |RT2j for closed case). So the universal moduli space UAi^Y = dj v (0) 
is smooth manifold with boundary, and similar to the Proposition 17.1 in |FOOO| for 
special case g = and I = 0, and the Theorem C.10 in |McSj . it is easy to calculate the 
dimension of UA4^_ Y which is 

dimMlj{X,L,d) = ^(d) + n(l - g) + k + 21 - dinu4itt(£). 

Then we will show that the contact condition corresponding to each pair of ordered 
sequences (r, s) is transverse. That will imply that the irreducible part UA4^ is a 
manifold. 

Given nonnegative integers K, L. We denote by Div^'^ (£) the space associated with 
£ which is the set of formal sums (with degree (K, L)) 

rn 

Y Y Kai5ai + Y L 3 (j ^ 

a=l i j 

where 5 a i E (<9£) a , o~j G S and integers K a i, Lj > with only finitely many of them being 
nonzero such that ^2 ai K a i = K, Lj = L. This is a smooth manifold of dimension 
K + 2L. 

For each pair of sequence (r, s) such that deg r = K, deg $ = L, let Div( r ffi )(S) C 
Div^'-k) (E) be the subset consisting of sums of the form 

m k a 1 

Yl Yl TaiXai + Yl ■ 
a=l i=l j=l 

This is a smooth manifold of real dimension k + 21. 
Moreover, for each such pair (r, s) define a map 

T (r , s) : UMl +w — > Div^ L )(S) x Div (P)S) (E) 

by 

m k a 1 

^{T, s ){ u ,J^,z,w,{x ai },{yj}) = (u~ 1 (V),^2^2r ai x ai + ^2s j y j ) 

a=l i=l j'=l 
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where x a i, yj are the additional k + £ intersection marked points. By Lemma \4.2\ there 
are local holomorphic coordinates z ai on a half open disc T> in S containing p ai or z 3 on 
an open disc O in £ containing q 3 , and u{p ai ) G Ly C X and «((/.,) G^Cl such that 
the leading terms of the normal component of u are z^ a% and z 3 3 , respectively. That is 

T (r,ffi)(^, <A ^ ^ W, {X ai }, {yj}) = K m Pai + ^ £j <?j , ^ r jX j + ^ Sj%) 

with K ai ,L 3 > 1, = K,J2Lj = L. Let A C Div( A '' L )(£) x Div (r>s )(E) denote the 

diagonal of Div( r ffi )(E) x Div( r s ,)(E). Then 

"•<'Xi= T (i)( A )- ( 5 - 4 ) 

If T( r ffi ) is transverse to A, then UM^\ k j is a manifold. Hence we only need to show that 

at each fixed (u, J, u, z, w, {x a i}, {yj}) £ ^-^k'fk i(^> ^> d) the differential -DT is onto the 
tangent space of the first factor. 

For this aim, similar to the method in |IPlj . we construct a deformation 

(ut, J,v u z,w,{x ai },{y 3 }) 

with 

dju t = Vf (5.5) 

We require that (u t , J,u t , z,w,{x a i}, {yj}) is tangent to UA4^ +k l+l to first order in t, 
where the zeros of are, to first order in t, the same as those of the polynomials 
z^ L + tip L (z L ) where ip L is an arbitrary polynomial in z b of degree less than K L defined 
near z L = 0, and the degree K L equals to K ai or L 3 . For simplicity we consider fixed l and 
omit it from the notation. In fact, it suffices to do this for tp{z) = z k for each < k < K 
since the map DT is linear. 

Choose smooth bump function (3 supported in small disc or half disc with f3 = 1 in a 
neighborhood of z = 0. We also fix local coordinates {v 1 } = {v ll ,v n } for V around u(0), 
and extend these to coordinates {v l ,x} for X ({u* 1 ,^ 1 } for L) around u(0) as described 
before in Lemma 1-4.21 

For any function r/(z) with 77(0) = 1 (if around the boundary marked points, we further 
require that r](r) 6 R, i.e. the restriction of r/ to the real part is real ), we construct maps 

ut = (ui;,u$ + tpz k ri). (5.6) 

The zeros of Uq + tf3z k rj have the form zt(l + 0(t)), where zt are the zeros of z K + tz k . 
Then the variation u at t = is £ = (3z k i] < yiy, where 91 y is a normal vector to V, in 
particular, if the omitted subscript l = at, i.e u(0) is the image of a boundary intersection 
marked point, then the normal vector dly is just the normal vector of Ly in L at u(0). 

Keeping J, z (or w), p (or q) fixed, we will show that we can suitably choose the 
function r/ and a variation z> in v such that (£, 0, z>, 0, 0) is tangent to UA4^ +k L, d). 

That means the following two conditions are to be satisfied. 
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(1) If (£,0,^,0,0) is tangent to the universal moduli space it must be in the kernel of 
the linearized operator of the map (|5.2p . thus, we have 



D£(z) - u(z, u{z)) = (5.7) 

where D is given by 

D u (0 = du€ + 2 V C J dn ° i ~ 

(2) On the other hand, we must choose the variation v respecting to the ^-compatible 
condition in Definition 14. 11 That means (0, v\ which is the variation of (J,v), must be 
tangent to § v . Thus v must satisfy the linearization of equations in Definition 14. 1\ i.e. 



v 



- o, [(jv K) j)m v ] N = [(v^.z> + jv. mv v)] N (- 



along V . These equalities hold if u, in the local coordinates above, has an expansion near 
x = of the form 

v = A(z,v)+B(z,v)x + 0(\z\\x\) (5.8) 



satisfying A N = and B N = \[{JV A {8/dz) J)W 



v\ N - 



To choose r/ and v satisfying (|5.7p and (|5.8p . we first write v = v v + v , and take 

i? = m v 

along the graph {(z, v(z),z )} of ito and extend it arbitrarily to a neighborhood of the 
origin. If we want to take u N of the form (|5.8p . we have to solve the following equation 
locally around the origin 

D N £(z) = u(z, v{z), z K ) = B N ([D£(0)] v )z K + 0(|z|^ +1 ) (5.9) 

where D N is the operator in (|4.4|) . 

We can write £ = a^ly + 7</9fy where a and 7 are real. Identify it with £ = C^fy 
where a+i7 is complex. When considering boundary marked point, recall that we take 
Vlv £ Nl v and so 7 = 0, £ = aWly- The operator D is real linear, so we have 

DC = (d()m v + (E + (F (5.10) 

with 

E = \[D{K V ) - JD(m v )], F = l -[D{K v ) + JD(m v )]. 

Since we want to find a solution of the form £ = f3z k rj near the origin, we can take f3 = 1. 
Then substituting £ = into the equation (|5.9|) we get 

- z fe <9?7 = z k V E N (z, z) + z k f]F N (z, z) + B N ([D£(0)] v )z K + 0(|^ +1 ). (5.11) 

Note that when considering boundary marked point and restricting to the real part, the 
equation ()5.11j) restricts to real equation 

_ l r k^L = r k r,D N (V\ v ) + B N r K + 0(r K+1 ). (5.12) 
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When k = 0, the equation (|5.1ip can always be solved by power series expansion. 
When 1 < k < K, we have £(0) = 0, so B n ([d{(0)] v ) = by (15111 . Then from the next 
Lemma, we know that F N has the form of az K ~ l + 0{\z\ K ), so (|5.1ip is turned into 

-Br] = r]E N (z, z) + az k fjz K - 1 - k + 0(\z\ K+1 ~ k ), 

which can also be solved by power series. Moreover, when restricting to the real part, the 
solution would obey the equation (|5.12p . that implies that the 77 is desired. □ 

Lemma 5.2 Near the origin, F N = az K_1 + 0(\z\ K ) for some constant a. 

Proof. Fix a vector 7 tangent to the domain of u. Denote T = dui^f). Then using the 
formula (j4.3[) and the (J, z^)-holomorphic map equation du{~f) = 2f( 7 ) — J o duo we 
calculate 

4^(^X7) = 4F N (T,j) 

= j(v r j)K v -(Vj r j)m v + (v mv j)jr 

+J(v mv j)jr + 2(v Jl/(7) )9V - 2(Vg tv J)Mrr) 
-2(Vj<n v - 2(V<n yZ /) 7 - 2J(V mv u) 1 . (5.13) 

Note that the normal component of T = du( 7 ) is Kz^" 1 ^ + 0(|z|^). Thus we only need 
to calculate (|5.13p for the components of T in the V direction, since the difference is of 
the form z K ~ 1 &i(z, z). Note also that 

J(v(z),z K ) = J(v(z),0)+O(\z\ K ), 

and 

VJ=(VJ){v{z),0)+O(\z\ K ). 

So for r tangent to V and for J, VJ taking values at (v(z),0), by the ^/-compatibility 
conditions in Definition 14. 1\ we can verify that (|5.13p vanishes. This completes the proof. □ 

6 Limits of F-regular open maps 

We come to construct a compactification of each component of the moduli space of 
T^-regular open maps. Using this compactification and the method by Solomon of defining 
open GW invariants, we can define relative open invariant for symplectic-Lagrangian pair 
(X,L), where the Lagrangian submanifold L is the fixed point set of an anti-symplectic 
involution (j), of dimension 3 if L is orientable and of dimension 2 if L might not be 
orientable (under some additional assumptions). 

To compactify ■M.^'^ l (X, L, d), we take its closure 

CM^jX,L,d) (6.1) 

in the stable moduli space Ai)c+^i+i(X,L,d.). In fact, the closure lies in the subset of 
•^k+i,i+i(^! L, d) consisting of open stable maps whose last k + £ marked points are 
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mapped into V, still with associated multiplicities (r, $), although the actual order of 
contact might be infinite. 

We will show that the closure is an orbifold with boundary. That is to prove that the 
frontier CM V \M V is a subset of codimension at least 1. Since such frontier is a subset 
of the space of stable maps, it is stratified according to the type of bubble structure of 
the domain. The following proposition is the main result in this section describing the 
structure of the closure CA4 V . 

Proposition 6.1 For generic pair (J,i>) £ J v , each stratum of the irreducible part of 

CM^;l l (X,L,d)\M^l l (X,L,d) 

is a manifold of dimension at least one less than the dimension 115. 3\) of Ai^'J'^^X, L,d). 

We will prove this proposition for different cases, according to the different types of 
limits: 

Case 1. stable maps with no components or special ((k,l)-marked and double) points 
lying entirely in V; 

Case 2. if Ln V ^ 0, a stable open map with smooth domain which is mapped entirely 
into V; 

Case 3. stable maps with some components in V and some off V. 

Case 1. The analysis is essentially similar to the arguments in [FOOOj and |Liuj . Since 
we do not admit the degeneration of domain, each stratum of this type is labeled by 
the pair of positive integer numbers (lb, i) of boundary and interior double points of 
their nodal domain curve E. For such fixed S, the corresponding stratum is denoted 

Lemma 6.1 In the 'Case 1 ', for generic pair (J, v) £ J , the irreducible part of the stra- 
tum •Mjjj'^ j (X, L, d)g ofCA4 v is a manifold of dimension b + 2i less than the dimension 

Proof. Let £ — > £ be the normalization of S. Then £ is a smooth curve with a pair of 
marked points corresponding to each double point of £. We will prove that the irreducible 
part of UJvCfc*^ i(X, L, d)g , denoted simply by UA4*~, is a codimension lb + 2i submanifold 

of the irreducible part of UAd^J'^^X, L,d), denoted simply by UM-,. Then the Sard- 
Smale theorem implies the conclusion. 

For simplicity, we consider the special case that there is only one pair of such boundary 
marked points (21,212). We can define evaluation map at these two points 

evb : UM~ -^LxL, 

then UAi*~ is the inverse image of the diagonal A in L x L. Since by the arguments in the 
proof of the Lemma 15 . f I UM. g is a manifold, we only need to verify that the evaluation 
map is transverse to A. 

For this purpose, we fix an arbitrary (uo, {J,v)) £ evb~ 1 (A) and choose local coordi- 
nates in X around p = uq(zi) = uq (^2), and choose bump functions fi\ and fa supported 
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in small half discs around z\ and z%- Then we deformation no locally around z\ by 
ut = uq + t/3±v and locally around Z2 by ut = uo — tfow, where v(z) € TX around p such 
that v|k £ TpL. Also modify z/ so that z^ = <9nf. Then the derivative of this path ut at 
t = is a tangent vector % to UM~^ with ei>6*(<Q = (v(0), — v(0)). So et>6 is transverse to 
A. The dimension argument is direct since the degree of freedom of z% £ dT, is one. □ 

Case 2. If Ly = L n F / I, denote by 57W k : ^ L, d) the subset of strata of 

CM^}*'^(X,L,d) consisting of equivalence classes of open maps with smooth domain 
whose image is contained in (V, Ly). We see that 

5 ^SS,i(*> d) = CM^/X, L, d) n M k+k , l+l (^ L V , d). (6.2) 

We will use the linearized operator to characterize the maps in SA4 V . 

For each u G ,Mk4-k,z+i(V, -^V> d), denote by the linearization of the equation 
du = v &t the map u. Note that there is a surjective restriction map 

which maps a F-compatible pair (J, z/) on X to its restriction to V. Then by Lemma l5.ll 
for generic (J, u) G J^, the irreducible part of .Mk+k,z+]i(V, d) is a smooth manifold of 
dimension 

index D v = fj, v (d) + (n - 1)(1 - g) + (jfe + #s) + 2(Z + 4) - dirm4ui(E). (6.3) 

We consider several operators related to the maps in A^k+kB-iCV", Ly^d). First, we 
have the linearization ^ of the equation Bu = v. The domain space of ffi x consists 
of sections of (u*TX, u*TL) that satisfy the linearization of V-contact conditions specified 
by the pair of sequences (r, $), and with index given by (|5.3|) . 

Secondly, there is an operator D N similar to (|4.4p obtained by applying D x to vector 
fields normal to V and then projecting back onto the subspace of normal vector fields. It 
is a bounded operator on the Sobolev completion W p ' 2 (u* Ny, u*Nl v ) with p derivatives 
in L 2 , i.e. 

D N : W p ' 2 ((E,dT,),(u*Nv,u*N Lv )) -> W^ -1 > 2 (T*E ® «*iVv). (6.4) 

Forp > deg r+degs, we have a closed subspace W?^s(u*Nv, u*Nl v ) consisting of sections 
satisfying the linearization of ^-contact conditions specified by (r, s). Then denote by 
D¥ ^ the restriction of D N to that subspace W?' 2 ^. We can calculate the index of D¥ s 
by 

index s -. — index D v 
fJ-N v (d) + 1 - 9 - deg r - 2deg s 
1-5 (6.5) 

since deg r + 2deg s = HN v (d)- 

The following lemma is a key observation 

Lemma 6.2 Each element of SM^ L, d) is a map into V with ker DP. 7^ 0. 



index D (riS) = 



34 



Proof. We adopt the renormalization argument similar to ones in |IP1] and [T]. Suppose 
there exists a sequence {u n } in .M^k j(X, L, d) converges to a 6 A4k,+k,i+l(^> -^V> d). 
Since in this case no bubbling occurs, u n — > u in C°°. When n is large enough, the images 
of maps u n lie in a neighborhood of V, so we can identify them with a subset in the normal 
bundle Ny of V by the exponential map. Denote by u n the projection of u n to V along 
the fibers of Ny, so that u n — > u in C°°. 

Then denote by Rt : AV — > AV the dilation with a factor of j, t € K + . For each n, 
there exist a unique t = t n such that the C 1 -norm of the normal component of the map 

Rn{u n ) ■■= Rt n {u n ) 

is 1. Obviously, t n —> 0. Let U n = R n (u n ) denote these renormalization maps. They are 
holomorphic with respect to the renormalized pair (iZ* J, i?* u), i.e. 

d R * nJ U n - R* n u = R* n (Bju n -u) = 0. (6.6) 

We can see that 

(R* n J,R* n u) -> (j ,uq) 

in C°°, where the limit (Jo, z^o) is dilation invariant and equals to the restriction of (J, v) 
along V. Also the sequence {U n } is bounded in C . So we can apply the classic elliptic 
bootstrapping techniques and obtain a converged subsequence U n — > Uq satisfying 

dj U = u . 

The map U n can be written as exp Un ^ n where ^ n G r(iu* Ny, iu* Nl v ) is identified 
with the normal component of ?7 n , whose C 1 -norm is 1. Then U n — > Uq implies that 
J n ->(£ T(u* Ny ,u* Nl v ) in C°°, and ^ is a nonzero section since the normal component 
of Uq has C 1 -norm equal to 1. Note that the limit £ has zeros specified by (r, s) since 
{u n } are under the contact constraints described by (r, s). Thus we only need to show 
D»£ = 0. 

Denote by T n the parallel transport along the curves exp 1Uri (t^ n ), < t < t n . And we 
can write u n = exp u (t n £ n ). For each fixed n, u n and u n have the same domain, then by 
the definition of linearization 

T~ l (dju n - v Un ) - (dju n - v u J = D Un (t n £ n ) + 0(|t„^ n | 2 ). 

Since u n is (J, z^)-holomorphic, the first term in the above equation vanishes. And the 
Definition I4.1f 1) implies that the normal component of BjT\i n — u nn vanishes since the 
image of the projection u n lies in V. Dividing the equation above by t n and taking limits 
of normal components, we obtain 

D%£= lim < n (e n ) = 0, 

n->oo 

since ICnlc 1 = !■ That means kevD^^ ^ 0. □ 

The operator D£ s * depends only on the 1-jet of (J, v) € J v , thus we can consider the 
restriction map 

3 V -> J 1 (6.7) 
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which maps a ^-compatible pair (J, v) on X to its 1-jet along V. 

Denote by UM(V, Ly, d) the universal moduli space of all open pseudo-holomorphic 
maps into (V,Ly). This space is a fiber bundle over J 1 . Its elements are denoted by 
(u, J, v) . Then we can define a bundle 

Fred 

| (6.8) 
UM{V,L v ,d) 

where Fred is the bundle whose fiber at u is the space of all real linear Fredholm maps 
(|6.4p of index i < 0. We can consider Dj^ s ^ as a smooth section of (|6.8p if index D^t ^ < 0. 
Since the arguments by Koschorke [K] can apply to the real Fredholm operators, we see 
that 

Fred = [J Fred^ 

k 

where Fredfc is the codimension k(k — l) submanifold consisting of all the operators with 
k dimensional kernel. Note that, at an operator D, the normal bundle to Fredfc in Fred is 
Hom(ker D, cokerD). 

Lemma 6.3 The section of \6.8\) is transverse to each Fredfe. 

Proof. Fix (u, J, v) £ UM.(V, Ly, d) such that the operator -D^^ at (u, J, v) lies on Fred^. 
To verify the transversality, it suffices to show that all elements in Hom(ker ^ , cokerZ)^ ^ ) 
can be realized by some variations. In fact, for any nonzero elements k G kerZ}^^ and 
c E ker(D^ ffi ^)*, we aim to find a variation in v such that 

jf(c,(5Z>£ s) ) K > dvol/0, 

since, by Theorem C.1.10 in [McS] . (5D^ s ^)k 6 cokerD^^. In the inequality above, 

the brackets mean the inner product on the domain E and (D N )* denotes the I? formal 
adjoint operator 

(D N )* : W p ' 2 (T*Z ® u*N v ) W -1 ' 2 ((E, <9E), (u*N v , u*N Lv )). 
Denote by tt n the projection onto the normal bundle. Note that D^,s = ir N o D x s y so 

(SD^ s) )k = (5n N )Df IjS)K + 7 r N (SD x )K + 7C N D x (S7r N ) K , 

where the operator D is given by ()4.3p . We want to take the variation with (u, J) fixed 
and v varying as vt = v + t\i with ji = along V. Thus tt n is fixed and we get 

! (c, (5D^ s) )k) dvol = I (c, (5D x )k) dvol = - I (c, V K ^> dvol. 

Take a point x £ E such that k(x) 7^ 0. Choose a neighborhood of x in E and 
a neighborhood U of ti(x) in X such that the section k restricting to W has no zeros in 
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U. Extending i to a smooth section c of Hom(T£, TX) along W x U such that c|y is a 
section of Hom(T£, Ny). 

Then we construct the (0, 1) form ^ such that its 1-jet along V satisfies 

v\v = 0, V K ( y) fi{x,y) = (Pc)(x,y) 

and 

Vj K ( y )Li(x,y) = -J(P<c)(x,y), 

where (3 is a smooth bump function supported on W x U with j3 = 1 on a slightly small 
open set. Since \jl vanishes along V, the left-hand side of the formula (3) in Definition 14.11 
vanishes, so the compatibility conditions are satisfied. Furthermore, 

I (<c, (SD^ s) )k) dvol = - I (c, V K //) dvol = - / /3|c| 2 dvol. 

Note that <c G ker(Z)^ ffi ^)*, i.e. it is the solution of an elliptic equation, so the unique 
continuation theorem for elliptic operators implies that |<c| can not vanish on any open 
set. Then the lemma is proved. □ 

Lemma 6.4 In the 'Case 2', SA4^'^JX,L,d) is contained in the space 

M'(V,L v ,d) = {u G M k+w (V,L v ,d) | kevDf Ts) £ 0}. (6.9) 

Furthermore, for generic (J, v) G S v , the irreducible part of Ai'(V, Ly, d) is a submanifold 
of the irreducible part of Mk+ui+i(V, Ly, d) of at least dimension 1 less than \5.3\) . 

Proof. Obviously, Lemma 16.21 implies the first conclusion. Then, note that the equality 

index D^ s) = dim M£j^(X, L, d) - dim A4 k + kl z+i(^ L v ,d), 

if index D^,^ > 0, by (|6.5p index DF. s j = 1, the second statement is trivial. So we just 
assume that t = index D? < 0. 

(T S S) 

Denote by 

UM' = (D^r 1 (Fved\Fved ) 

the set of elements (u, J, v) G WA / fk+k,!+l(^ ^Vj d) for which ^ has a nontrivial kernel. 
Then by Lemma 16.31 UM' is a codimension (1 — t) subset of WA^k+k i+n(^j ^Vi d), and in 
fact a submanifold off a set of codimension 2(2 — t). Since the projection 

7T : WM' -»• J 1 

is Fredholm, the Sard-Smale theorem implies that for a second category set of (J, u) G J 1 
the fiber ([621) 

7T _1 ( J, i/) = 1 M / (V,Ly,d) 

is a manifold of dimension 

index D v - (1 - i) = index L» y + index D^ s) - 1 
= index Z>£ s) - 1. 

The inverse image of this second category set under (|6.7p is also a second category set in 
S v . That is to say, for generic (J, 1 ^) G 3 V , the irreducible part of (|6.9p is a submanifold 
of codimension at least one in CM^'J'^^X, L, d). □ 
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Case 3. Now we consider the last case that there is a sequence of ^/-regular open maps 
converges to a limit map u G CAi^'J'^^X, L, d) whose domain is the union £ = Si U £2, 
where £1 and £2 are bubble domains of genus g± and 52, and u restricts to a F-regular map 
u± : £1 — > X and a holomorphic map u 2 '■ £2 - >■ V into V. Limit maps of this type arise 
from sequences of ^/-regular maps in which either (1) two of the (k, l)-contact intersection 
points collide in the domain or (2) one of the original (k, Z)-marked points whose image 
sinks into V, collides with a contact point. In either case the collison produces a ghost 
bubble map U2 ■ £2 — > V whose energy is at least hy by Lemma 12.11 

Then note that u^ 1 (V) consists of the nodal points £1 n £2 and some of the last k + £ 
marked points p ai G <9£, q 3 G £. The nodes are defined by identifying points x 3 G £1 and 
yj G £2. Since u\ is F-regular and u\(x 3 ) G V (resp. in Ly if Ly 7^ 0), then Lemma I3~2l 
associates a multiplicity s'- (resp. r'-) to each x 3 , the multiplicity vector is denoted by 

»' = (s'i,s' 2 ,---) (resp. t' = (r[,r' 2 ,- ■ ■) ). 

For convenience, images of these nodes xj and yj is denoted by vectors (Ik', 1'). Similarly, 
since u arises as a limit of ^/-regular maps, the q 3 (resp. p a i), which are limits of the 
contact points with V (resp. Ly), also have associated multiplicities. We split the set of 
q 3 (resp. p ai ) into the points {q^} (resp. {p^}) on £1 (resp. <9£i) and {q^} (resp. {p 2 ai }) 
on £2 (resp. ^£2), denote by 

sl = ( S 1 5 S 2'---) and * 2 = ( s l> s 2r--) 

(resp. r 1 = (••• ,r^,---) and r 2 = (■■■, r 2 ai , •••) ) 
the associated multiplicity vectors. Hence we write u as a pair 

u = (ui,u 2 ) G ^JiS/.^+rC^-t'jdi) x Ai S2) k 2 +k2+k',W2+l'(^^v,d2) (6.10) 

where dj = [nj] with di + d2 = d satisfying the matching conditions u\{x 3 ) = 112(1/ j), and 
(k 1 ,/ 1 ) + (k 2 ,/ 2 ) = (k,/). 

Lemma 6.5 In this case 3, the only elements H6.1(J\) lying in CA4^ TS ^ are those for which 
there exists a (singular) section £ G r((£, 5£), (u 2 Ny, u 2 Nl v )) nontrivial on at least one 
component of £2 with zeros of order r 2 ai at p 2 ai G (9£) a , a, = 1, • • • ,m, or of order s 2 at 
q 2 G £, poles of order r'j or s'j at yj, and = where D^ 2 £, is as in 

We still use a renormalization argument similar to the one used in Lemma 16.21 Since 
we consider poles of the section, we will discuss the renormalization in a compactification 
Fy of the normal bundle ir : Ny — > V . Before starting the proof, we recall the description 
of Fy given in |IPlj . 

First, note that Ny is a complex line bundle with an inner product and a compatible 
connection induced by the Riemannian connection on X. In fact, we have 

vr P : Fy = F(N V © C) -> V, F Lv = F{N Lv © R) -> Ly, 

i.e. Fy is the fiberwise complex projection of the Whitney sum of Ny with the trivial 
complex line bundle. 
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We define the bundle map 

t:N v ^F v 

fiberwise by 

l{x) = [x,l]. 

It is a embedding onto the complement of the infinity section T4o C Py . The multiplication 
map Rt(0 = £/t on Ny defines a C* action on Py. 

When V is a point we can identify Py with P 1 and give it the Kahler structure (co £ ,g £ ,j) 
of the 2-sphere of radius e. Then i : C e — >■ Py is a holomorphic map with 

L*g £ = <p 2 £ [(dr) 2 +r 2 (de) 2 ] 

and 



where 



t*w e = A dO = dip £ A dd 



2e , , , 2e^r 



2„2 



1 + r 2 1 + r 2 

This construction globalizes by interpreting r as the norm on the fibers of Ny, replacing 
dO by the connection 1-form a on Ny and including the curvature F a of that connection. 
So we have a closed form 

l*U £ = TT*UJy + 1p s 1T*F a + c^ £ A a 

which is nondegenerate for small e and whose restriction to each fiber of Ny agrees with 
the volume form on the 2-sphere of radius e. 

At each point p £ Ny the connection determines a horizontal subspace which identifies 
T p Ny with the fiber of Ny © TV at n(p). The fibers of Ny have a complex structure jo 
and a metric go, and restrict J and g on X to V, then one can verify that for small e the 
forms 

w e , J = jo©«/|y, and <7 e = O £ # ) ©ff|y 

extend over to define a tamed triple (oj e , J,g £ ) on Py. Note that Lemma I2TT1 also holds 
for tamed structures, and so we can choose sufficiently small e such that every (J, v)- 
holomorphic map u from S = S 2 or D 2 onto a fiber of Py — > V of degree d < • V 
satisfies 

f s \du\ 2 <^- (6.11) 

where fi. is the constant associated with V by Lemma 12. 11 We fix such an e and write u £ 
as wp. Denote by Vq the zero section of Py. 

Then we identify an e' < e neighborhood of Vq in Py with a neighborhood of V C X 
and pullback (J, g) from X to Py. Fix a bump function /? supported on the e' neighbor- 
hood of Vo with j3 = 1 on the e'/2 neighborhood. For each small 4 > let fit = P ° Rt- 
Starting with the metric ht = fitd + (1 — Pt)9e, using the procedure described in the ap- 
pendix of |IPlj . we can obtain a compatible (u?p,Jt,gt) on Py- Then as t — > we have 
Jt — > J in C° on Py and — > go on compact sets of Py \ . 
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Proof of Lemma \ 6.5[ Suppose that a sequence of V-regular open maps u n : £„ — > X 
converges to u = (111,112) as above. That is, the domains S n converge to S = Si U £2, by 
Theorem 12.11 u n converge to u : S — >• X in C° and C°° away from the double points of 
£, preserving the energy. For the interior double points, the argument is the same as the 
one in |IPlj . so for simplicity we only consider the boundary double points. 

Around each double point Xj = yj of <9£i n SX2 we have coordinates (zj,Wj) G H 2 in 
which S n is locally the locus of {zjWj = Hj >n } and £1 is locally {zj = 0}. Let Aj >n be the 
half-annuli in the neck of the bordered neck of E n defined by 

4?> = {\H,n\/S < \zj\ < 5}. 

Denote by Y,' n C £ n the bordered neck A n = \JjAj^ n together with everything on the £2 
side of A n , and denote the restriction of u n to T,' n by u' n . 

The restriction of u n to T l ' n \A n converge to va- By Lemma [2TTI there exists a constant 
hy depending only on V such that the modified energy E(«2) > ^v, since the image of ^2 
lies in V . Then we fix 5 small enough so that the modified energy of u = (u\, 112) inside 
the union of 5-balls around the double points is at most for sufficiently large n 

E(Tr v ou n \v n \A n )>frv/2 (6.12) 

and 

EKUJ < hv/16. 

Note that for large n the image of u' n lies in a tubular neighborhood of V which is 
identified with a neighborhood of Vq in Fy. Using renormalization Rt : Ny — > Ny and 
the bundle map 1 : Ny Py, u' n gives rise to a one-parameter family of maps 1 o R t o u' n 
into Py. We can consider the modified energy (|2.6p of the corresponding map 

1 o Rt o u' n : S; -»• Py 

on the part of the domain which is mapped into the upper hemisphere Py calculated using 
the metric g £ on Py constructed above. The energy is close to zero for large t and exceeds 
Hy /A for small t by f)6.12[) . Therefore there exists a unique t = t n such that the maps 

9n = t° Rt n ° u n : -> Py 

satisfy 

E ^I 9 ,T 1 (p+)uaJ = X' (6 ' 13) 

Noting (|6.12p . t„ — >• as n — > 00 since ti n (S^ \ A n ) — > V pointwise. 

Next, consider the small bordered annuli Bj tn in the bordered neck of S n defined by 
{5/2 < \wj\ < 5} and let B n = UjBj >n . On each Bj >n , u n converges in C 1 to 

r '. 

Ui = (djWj 1 H ) 

and u n (Bj tn ) is of small diameter. Thus, after passing to the subsequence and taking 
smaller 5 if necessary, each g n (Bj^ n ) lies in a coordinate neighborhood Vj centered at a 
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point qj 6 Voo with diam 2 (Vj) < hy /WOO. Fix a smooth bump function /3 on £„ which is 
supported on Ti' n satisfying < f3 < 1 and /3 = 1 on \ B n , and such that on each Bj n 

\d(3\ 2 < 100. (6.14) 

Then we extend to a new curve with boundary in the Lagrangian submanifold, 
that is to smoothly attach a half disc Hj along the half circle 7«- n = {\wA = 5}. Extend 
9n to 

g n : £ = ^ U -> Py 

by setting g(Hj) = qj and coning off g n on £>j in by g n = (3 ■ g n in the coordinates on 
Vj. The local expansion of u\ shows that u^^j^), oriented by the coordinate Wj, has 
winding number r'- around Vo- The same is true for g n (lj,n)- So in relative homology, [g n ] 
is b*[u2\ + r'F where r' = Y2 r j anc ^ ls * ne fiber class of (Py,PL v ) — > (V,Ly). 

Then by (|6.13p and (|6.14p . the energy of g n on the region that is mapped into Py is 
bounded by 

/ , + \ d 9n\ 2 + J>am 2 (V}) / \dp\ 2 < (6.15) 

On the other hand, in the region mapped into Py, g n = g n is ( J n , f n )-holomorphic 
with J n — > J and v n — > 7r*z^y, so the energy in that region is dominated by its symplectic 
are (12.31). So we have 



E(5n| g -i (P - } ) < ^ + ci / 

< ^7- + ciwp • [g n (E n )] +ci| f 9nU ¥ \. (6.16) 
2 Ja^Wt) 



Combining with (|6,15p we have a uniform energy bound 

E(5n) < ciw([u 2 ]+r'F) + C2. 

Also the restrictions g' n of g n to £^\.B n have such energy bound. These g' n are (J n , i/ n )- 
holomorphic maps, so we apply Theorem 12. II to obtain a subsequence which converges to a 
(J, 7r*^y)-h°l°morphic map whose domain is £2 together with the half-discs {\wj\ < 5/2} 
in Si and some possible bubble components. 

After deleting these half-discs, the limit is a map 

g : C 2 -> Py 

with go(yj) G Kxj at marked points Note that the projection it o g' n converge to 
ii2, so the irreducible components are divided into two types: (1) Those components 
biholomorphically identified with components of C2 on which go is a lift of 112 to Py and, 
(2) those mapped by go into fibers of Py which are unstable bubbles and can be collapsed 
by the stabilization. Then (|6,15p implies that no type (1) component is mapped into Voq. 
Since the type (2) components are (J, 0)-holomorphic, then by (|6.12p these components 
contribute to the integral (|6,15p at most hy/8. So at least one component of type (1) is 
not mapped into Vq by go . 
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Lemma 14.61 savs that each component of go has a local expansion normal to T4o given 
by bjZj 3 + • • • at each yj £ dY<2- Note that dAj >n \ L = 7j >n U 7^ n , where jj is the 
half-circle {\zj\ = 5} oriented by Zj. Thus dj is the local winding number of g n (lj n ) with 
Vx, which is equal to the local winding number of g n (lj,n) with V^, that is just r'-. 

Since g' n — > go on £2, the sections £ n of u^Ny, satisfying exp(£ n ) = L~ 1 g n , converge to 
nonzero £ satisfying exp(£) = L~ 1 go- Then by the same arguments in the proof of Lemma 
16.21 = 0, and the calculation above implies that £ has a pole or order r'- at each 

boundary double points yj. Moreover, g n have the same zeros and multiplicities as u n , 
so the zeros of £ are exactly the last k + £ marked points of the limit curve £2 with the 
original multiplicity pair of vectors (r,s). □ 



7 The space of V-stable open maps 

From last section we see that the limit of a sequence of l^-regular open maps is a stable 
map whose components are of the types described in Case 1-3. Actually, the components 
of the limit map are also partially ordered according to the rate at which they sink into V. 
In this section we will make this precise by introducing a layer structure on the domain, 
and then construct a compactification of the space of ^/-regular maps. 

Let S be a stable curve with boundary. 

Definition 7.1 A layer structure on £ is the assignment of a non-negative integer Xj to 
each irreducible component £j to £, such that at least one component must have Xj = 
or 1. 

The union of all the components with Xj = K is called the layer K stable curve, denoted 
by Ak ■ Note that Ak might not be a connected curve. 

Definition 7.2 A marked layer structure on a (k + k, 1 + 1) -marked bordered stable curve 
^k,i,k,i is a layer structure on T, together with 

(1) a pair of vectors (r, s) recording the multiplicities of the last k + I boundary and 
interior intersection marked points, and 

(2) a pair of vectors J3) which assigns multiplicities to each boundary double point 
of dAx H 8Al, and to each interior double point of Ak H A^, K 7^ L. 

Note that double points within a layer are not assigned a multiplicity. 

Each layer Ak then has boundary points pk,i of type (1) with multiplicity vector 
^K = ( r K,i) (here we do not distinguish the different boundary components) and interior 
points qK,j of the same type with multiplicity vector $k = (sk,j), and has double pints 
with multiplicities. The double points in Ak that are assigned multiplicities are divided 
into two types. Let & K (resp. $ K ) be the vector derived from <k (resp. J3) that gives 
the multiplicities of the boundary (resp. interior) double points y K i where Ak meets the 
higher layers at boundary (resp. interior part), i.e. the points 8Ak H 9Sj (resp. Ak H £•,) 
with Xj > K. Let & K (resp. § K ) be the similar vector of multiplicities of boundary (resp. 
interior) double points y Ki where Ak meets the lower layers. 

Then we associate operators similar to (j6.4j) defined on the layers Ax, K > 1, as 
follows. For the interior double points, the argument is the same as the one in |IPlj . so 
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we only consider the special case that we assume there are only boundary double points. 
For each choice of <w = w K = {a K ■} and p, fix smooth weighting function W® iP which has 

the form \zi\ p ajc ' i in some local coordinates Zi in a small half-disc centered at y Ki and 
has no other zeros. Then given a stable map u : Ax — > V, denote by L™_ ^(u*Ny, u*Nl v ) 

the Hilbert space of all L^ c sections of (u* Ny , u* Nl v ) over (Ak,9Ak) \ {yjci} which are 
finite in the norm 

Ufm*,8 = E / \W & ,l + S-V l £\ 2 . 
1=1 JA « 

For large m the elements £ in this space have poles with |£| < c\zi\~°' K - i ~ S at each 
y Ki and have m — 1 continuous derivatives elsewhere on Ak- For such m, denote by 
Lk s (u*Nv,u*Nl v ) the closed subspace of L™_ & {u* Ny ,u* Nl v ) consisting of all sections 

that vanish to order r^j and skj at pkj and qx,j and order a K i at y K v Hence by elliptic 
theory for weighted norms, the operator D N defines a bounded operator 

D K : L% iS ((A K ,dA K ),(u*Ny,u*N Lv )) ^ U£f +1 {T* A K ® u* Ny). (7.1) 
For generic < 8 < 1, is Fredholm with 

index D% = /j, Nv ([u{A K )]) + x(^-k) + (deg <u K - deg - deg <k£) 
+2(deg - deg Si <: - deg J3+ ) 
= x(Ak) (7.2) 

where x(Ax)is the Euler characteristic of Ak, and the index formula would be more general 
for cases admitting interior double points. The formula is derived from the fact that the 
Euler class of the pair of complex line bundle and totally real sub-bundle (u* Ny,u* Nl v ) 
can be computed from the zeros and poles of a section. 

Then we give the following definition of the stable maps we want. 

Definition 7.3 A V -stable map is a stable map u £ .Mk+k,£+ii(A^ L, d) together with 

(1) a marked layer structure on its domain £ with u\\ being V -regular, and 

(2) for each K > 1, an element £k S ker defined on the layer Ak that is a section 
nontrivial on every irreducible component of Ak- 

Denote by -M^J'^ ^X, L, d) the (r, s)-labeled component of the set of all ^-stable open 

maps. This contains the set -M^'J^^X, L, d) of ^/-regular maps as the open subset, i.e. 
the F-stable maps whose entire domain lies in layer 0. Forgetting the data £k defines a 
map 

& ■ Ml'J^iX, L, d) -> M k+ksl+l (X, L, d). (7.3) 

Note that the number of layers of a ^-stable map must be finite. Assume there 
are altogether r + 1 layers Aq, Ai, • • • , A r . Each ^-stable map (u, £i, • • • ,£ r ) determines 
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an element of the space T~Cf x L jj as follows. For sufficiently" small e, we can push the 
components in V off V by composing u with exp(e £k) and for each K, smoothing the 
domain at the nodes Ak n (}Jl>k^-l) an d smoothly joining the images where the zeros of 
e K ^K on Ak approximate the poles of e +x £k+i- The resulting map 

U S = , "|Ao# ex P(^i)#---#exp(e r ^ r ) 

is V^-regular and represents a homology class Jf(u, = ^{ u i) £ %n. Note that 
this class is independent of the choice of the small e, and depends on each up to a 
nonzero multiplier. 

Thus, we have a well-defined map 

* ■■ mZ'^x, L, d) -+ H^; a L)>d . (7.4) 

The following proposition is an open version similar to the Proposition 7.3 in |IP 1 j . 

Proposition 7.1 There exists a topology on Ai^'i'^ i(X, L, d) such that this space ofV- 
stable maps is compact and the maps & of |7.3| j and ffl of |7,^[ ) are continuous and 
differential on each stratum. 

Proof. We analyze a sequence of ^-regular maps and a more general sequence of ^-stable 
maps to define the topology on -M k f'^ j(X, L, d). 

Let {u n : E n — > X} be a sequence of maps in -M^J^^X, L, d). By the bubble 
convergence Theorem 12.11 there is a subsequence, still denoted by u n , which converges 
to a stable map u : E — > X. We claim that the argument of renormalization in the last 
section will define the structure of a ^-stable map on the limit map. 

First, note that the last k + £ marked points converge, so the pair of intersection 
multiplicity vectors (r, s) of u n is invariant in the limit, that is the pair of vectors in 
Definition 17. 2f 1). Next, we inductively define the rest of the layer structure. Let Xj = 
on each component which is not mapped into V by u, thus we have the layer Ao- 
Denote by E(l) the union of those remaining components which are mapped into V. We 
assign to each boundary (resp. interior) double point y G AonE(l) a multiplicity a y (resp. 
f3 y ) which is equal to the order of contact of u|a with V at y. 

Then Lemma 16.51 gives the sections £ n> i (and the renormalized maps g n> i = exp^ n> i) 
which converge to a nontrivial element of £i £ kerD^ on E(l). We assign Xj = 1 to 
each component in E(l) on which £i is nonzero, and denote the union of the remaining 
components by E(2). Thus the Ai is defined and we obtain the section that is nonzero 
on each component of Ai. Furthermore, 

(1) vanishes at the boundary (resp. interior) double points y where Ai n E(2). We 
assign such y a multiplicity a y (resp. f5 y ) equal to the order of vanishing of £i at y. 

(2) The proof of Lemma 16.51 shows that £i has a pole at x G Ao n Ai of order a x (or 
f3 x ), and has zeros of order rn (or su) at the intersection points in Ai. 



4 Here the definition of HYx l) IS similar to the one of H^x appeared in the Definition 5.1 of [IP1] , 
Moreover, similar to the map (5.9) of [IPlj . we may get a well-defined map Ji? : A4^i(X,L) — > 1 HYx i l)> 
which records the homology-intersection data. 
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gives the same homology class in T~L v 



(3) Since — > £1, the argument above shows that, for large n, u n and 

u| Ao #exp(e^i)#5r ni i| s(2) 
V 

(X,Ly 

So we define the section £1 and the associated two pairs of vectors (r, s) and (&, J3) on 

Ai. 

Then we repeat the procedure of construction on S(2) and continue from the case on 
£(-?T) to the case on T,(K + 1). That defines inductively a layer structure on S, pairs 
of multiplicity vectors (ax, J3) for each point in Ak n + 1), and a nontrivial section 
£k £ kerDjf on each layer Ak- We only need to repeat finite r times because each T>(K) 
has fewer components than Y,(K — 1) and the total number of components of a stable map 
is finite. Finally, we have a nontrivial £k ° n each component of Ax, K > 1. Moreover, 
the limit V-stable map (u, £i, • • • , £ r ) defines an element in Hr^L) d' 

Then we come to consider sequences in Ai^^ L, d). Given a sequence f/ n = 
(u n ,^ n ) of V-stable maps, denote each layer by A^, we first define u n fl = u n \\n. Since 
the sequence {u ni o} has a uniform energy bound, applying the discussion above produces 
a subsequence converging to a V-stable map U . Similarly, the u Ui \ = ti n | converge to a 
stable map u\ into V and the renormalized maps exp(£ n i) : A™ — > Py have a subsequence 
converging to a limit exp(£o,i) with £o,i £ ker . Then U 1 = (iti,£o,i) is a V-stable 
map with image lying in V and its bottom layer coincides with the top layer of £7° to 
form a V-stable map U° U U . This process continues finite (say m) times since each layer 
carries energy at least hy. Hence, there exists a subsequence of {U n } which converges to 
a V-stable map U° U • • • U U m . 

Actually, the above procedure defines a notion of convergence of a sequence of V-stable 
maps. Such convergence defines a topology on Ai-^J'^^X, L,d). So in this sense, we see 
that M^'^i(X,L,d) is compact and the map Jf? is continuous with this topology. □ 

The next theorem is the key result needed to define the relative invariants, which 
implies the Proposition 16.11 



Theorem 7.1 The space of V-stable maps is compact and there exists a continuous map 

ev : Ml'JU X > L > d ) LM >< Xl >< <£lV ( 7 - 5 ) 

Moreover, the complement of M^'t AX, L, d) in the irreducible part of Ai^ J'^i(X, L, d) 
has codimension at least one. 

Proof. The discussion above implies compactness. For computing the dimension, we recall 
the operator (|7.ip . We can use the bubble domain curves £ = UA^- to label the strata of 
the space of V-stable maps, and denote these strata by A^ k 'f^i(S). For each layer Ak, 
K > 1, denote by 

^Xl U " K ' ffiKUPiUR (*> L, [u(A*)]) (7.6) 
the set of V-stable maps (u, £) such that the restriction 
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is a map from Ak to V so that the operator (|7.ip has a nontrivial kernel on each irreducible 
component of Ak, where the notation £(•) denotes the length of an intersection multiplicity 
vector. 

Under such setting we consider the Hilbert bundle over the universal moduli space 



L^{V)^UM AKtkK+ ^ K ^+^-^ K+c ^ KU ^ ufi) (V,L v , [u(Ajc)]) 

whose fiber at u : A K -)• V is the space L% s ((A K ,dA K ), (u*N v ,u*N Lv )) in JET]). Then 
we can use the same argument as the proof of Lemma 16.31 to show that defines a 
section of 

Fved(L™ s (V),L™; s \V)) 

(7.7) 



UM A K ,k K+ c(r K u^ K u.-),i K +c( SK ue+ K ue-)^ Lv > t u ( A ^)]) 

which is transverse to every codimension k{k — 4) subspace Fredfc of Fredholm operators 
with kernel of dimension k > 1. Then the following two lemmas gives the dimension 
statements of the theorem. □ 



Lemma 7.1 The irreducible part of the space (7.6) is a manifold of dimension at most 

d£ = fi X ([u(A K )]) + (n-3) X (A K ) + k K + 2l K 

+£(<sst K ) + C(tk) + £(®k) + (deg & K - deg t k - deg & K ) 

+2[£(® K ) + CM + CQfe) + deg r K - deg %k - deg J3+] - 1. (7.8) 

Proof. By Theorem 12.21 (2). generically 

M A K ,k K +c(T K u4 i u^ K ),i K +c( SK u&+u§ K )( V ^ L v^ [ U ( A A')])* 
is a manifold of dimension 

d K = fi v ([u(A K )]) + (n-3)x(A K ) + k K + 2l K 

+C(® K ) + C{t k ) + + 2[£(& K ) + C(s K ) + mi)}- (7.9) 

Comparing (j?T2]) . (jTg]) and (JESJ, we see that d£ -d£ = 4- 1 where 4 = indexL*^. If i > 
the lemma holds. 

If 4 < 0, we can still use the theorem of Koschorke and conclude that the set of 
u € A4a k (V, Ly, [u(Ak)])* with dim kerl>^ = k form a submanifold of codimension 
k(k — l) > (1 — 4) > 1 since k > 1. Since by Definition 17.31 (2) the section is nontrivial 
on every component of A#-, the lemma holds. □ 

Remark. If <9A A = 0, then d^ is just like the computing result in |IPlj which is 

d K = 2 Cl ([u(A K )}) + (n-3) X (A K ) + 2l K 

+2[£(J3~ ) + C(s K ) + C($c) + deg ® K - deg $ K - deg J3+] - 2. 

where ci denotes the first Chern class of TX. 
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Lemma 7.2 Each irreducible stratum -M k ' ; ^ is a manifold of dimension r + + 
2{r l + C l K ) less than \5. 3\) . where r b (resp. r l ) is the total number of nontrivial layers with 
nonempty boundary (resp. without boundary) and C b K (resp. L % K ) is the total number of 
boundary (resp. interior) double points, whether or not intersecting other layers, in layer 
A K , K > 0. 

Proof. Note that the stratum is the product of the spaces (|7.6p for each layer 

constrained by the matching conditions u(x) = u{y) at each of the C{u) + £((p) double 
points where meets other layers. Then we can use the transversality argument in 
[McSj to show that the irreducible part of this space is a manifold of expected dimension, 
the dimension has a upper bound 

r 

dim Afgf^E) < E d K ~ " 2£(|P). (7.10) 

K=0 

We also notice the following facts : 

(1) the formula (|7.8p is additive in the homology class u(A^) and the multiplicity 
vectors tk and sk- And we have the equalities 

(2) E/<=o de g w i = £^=o de S and E^=o de g ®K = £/f=o de g Px' 

(3) 

r 

K=0 

where £(<*) = E^K) = = ££((P£) = ££(©■ 

Then substituting the (|7.8p in (|7.10p . the dimension statements is verified. □ 

Remark. As the reason mentioned before, in the present paper, we will not use the map 
(17. 5p to define invariants which involve more delicate homology-intersection data. Instead, 
we only care about the simplest intersection data, so in the following, to define simpler 
invariants, we only use the evaluation maps at both marked and intersection points. 

8 Orienting the determinant line bundle over moduli space 

Let V — > B a vector bundle. Denote the i th Stiefel- Whitney class of V by Wi(Y). 
Define two characteristic classes p (V) € H 2 (B, by 

p + (V) = w 2 (V) , p- (V) = w 2 (V) + Wl (V) 2 . (8.1) 

From |KT] we know that p* (V) is the obstruction to the existence of a Pin* structure on 
V. 

Definition 8.1 Given a symplectic Lagrangian pair (X,L), we say L is relatively Pin* 
if 

p ± (TL) G Im(i* : H 2 (X,Z/2Z) -> H 2 (L, Z/2Z)). 

and is Pin* if p*(TL) = 0. If L is Pin*, we define a Pin* structure for L to be a Pin* 
structure for TL. If L is relatively Pin*, we define a relative Pin* structure for (X,L) 
consists of the choices of 
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1. a triangulation for the pair {X, L), 

2. an oriented vector bundle V over the three skeleton of X such that 102 (V) = p^(TL), 

3. a Pin^ structure on TL\ L (S) © V| L <3). 

Let us first introduce some notations. Recall that 

M*'{X,L,d) 

is the moduli space of ( J, z/)-holomorphic ^-regular open maps u : (E,5E) — > {X,L) 
with k a marked points z a \,--- ,z a k a on each boundary component (<9E) a and I marked 
points Wi, ■ ■ ■ ,wi and additional 1 interior intersecting marked points qi, • • ■ , q\ on S such 
that ii*([£,<9£]) = d and ^|(ai:) *([(9X) a ]) = d a , and t = I > 0. The compactification 

Aik'i L, d) is the space of V-stable open maps. We can define the evaluation maps at 
the (k, /)-marked points and intersection points 

Y s 

evbai : M k ]i t i(X, L, d) ->• L, i = 1, • • • , k a , a = 1, • • • , m, 
em,- : AT^psT, L, d) ->■ X, j = 1, ■ ■ ■ , I, 

evi] : Ml'^(X, L,d)^V, j = 1, • • • , 1. 

In fact, the moduli space above can be considered as the zero locus of a Predholm section 
of a Banach bundle. We denote by B 1,P (X, L, d) the Banach manifold of W ,p maps 
u : (£,<9X) — > (X,L) such that <9£]) = d and u\(Q^ a *([(dY,) a ]) = d a . And define 

B^ +l {X, L, d) := B 1,P (X, L, d) x ]J(d^ x \ A, 

a 

where A denotes the subset of the product in which two marked points coincide. Elements 
of B^ P +l (X, L,d) are denoted by u = (u,z,w,q), where z = (z a i), w = (wj), q = (q^). 

Then the Banach space bundle £ — > B^ p +l (X, L, d) is defined fiberwise with 

£ u :=!/(£, 
We define the section of this bundle as 

d(J,v):B^ +l (X,L,d)^£ 

d(J,v) u = du o j s + J o du — v{-, u(-), u), 
which is the z^-perturbed Cauchy-Riemann operator. We require the inhomogeneous term 
v £ T(S x X x B^ +l (X,L,d),Rom(-K* 1 TT,,TT^TX)), 

such that 

(1) v is (js, J)-anti-linear, i.e. v o j' s = — Jo zy; 

(2) l/ |g Sx jj ( 'xB 1 ' p (xLd) carries the sub-bundle ir'lTdT, C tt'ITT, to the sub-bundle 
ir'^iJTL) C tt'^TX, where vrj, i = 1,2, is the projection from S x X x L, d) to 
the i th factor. 

The vertical component of the linearization of this section is denoted by 

D := Dd M : TB^ +l (X, L, d) -> £. 
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Definition 8.2 A W 1,p -map u € B^ p +i (X, L,d) is called V -regular if no component of 
its domain is mapped entirely into V and if neither any of the \k\ +1 marked points nor 
any double points are mapped into V . 

Thus the parameterized ^-regular moduli space can be regarded as the zero locus of the 
section d^j^ which is denoted by 

M££(X,L,d) :=^(0)nBj;;(I,L,d). (8.2) 

Then similar to |Soj . we can define our moduli space A^Jf', \(X, L, d) as an appropriate 
section (or say slice) of the reparameterization group action, we refer the reader to the 
section 4 in |So| for details of construction. 

We simply denote by B v := B^ p \^ (X, L,d). The evaluation maps can also be simi- 
larly defined on this larger space 

evb ai : B v ->■ L, i = 1, • • • , k a , a = 1, • • • ,m, 

evij : B — > X, j = 1, • • • , I, 

evil : bV F ' J = 1 5 • ' ' , 1) if t = 1 > 1. 

such that 

evb ai (u) = u(zai), evij(u) = u(wj), evi^u) = u(q 3 ). 
The total evaluation map is denoted by 

ev := JJev& a i x JJeui,- x j £ euzj 
a,i j l>l,j 

ev : B^(X, L, d) -> x X 1 x V e . (8.3) 

Then let 

C := det(D) -> L, d) (8.4) 

be the determinant line bundle of the family of Fredholm operators D restricted to B v . 
And let 

C! = £(8)(g)e«6* i det(TL)*. 

o.i 

The following two propositions are the fundamental results of orienting the moduli 
space. We distinguish the following two situations 

(1) L is orientable and provided with an orientation. In this situation no restriction is 
required; 

(2) L is nonorientable, then we suppose the number of marked points on each boundary 
component satisfies 

k a ^ Wl {d a ) + l, (mod 2); (8.5) 
Denote by the i-skeleton of a manifold M. Then we define a subspace 

<B := {(u,z,w,q) E B^(X,L,d) | u : -> (A^ 3 \ L®)}. 

We first prove a lemma 
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Lemma 8.1 The combination of the relative Pin^ structure of (X,L) and the orienta- 
tions of L if it is orientable determines a canonical orientation of Cf\%. 

Proof. We just need canonically orient each individual line C' u for each u S !B in a way 
that varies continuously in families. Recall that the relative Pin^ 1 structure of (X, L) gives 
a vector bundle V — > X^ and a Pin^ structure on V|^(3) © TL\ L (3) . Denote simply by 

V R :=V| L ( 3) , V C :=V©C. (8.6) 

Choosing an arbitrary Cauchy-Riemann operator Dq on u*Yq, we consider the operator 
Ai® D , 

D U ®D : TB U © W 1 * (u*V c , u*V R ) — > £ © L^'V^c)), 

That is 

Wl' p {u*{TX © V c ), u\* d x(TL © V R )) © K |k| © C l+e -> L p (n°>\u*(TX © V c ))). 

We remark that the choice of Do is irrelevant since the space of real linear Cauchy-Riemann 
operators on u*Vq is contractible. 

Thus, we have a short exact sequence of Fredholm operators 

-»• D u -> D u © D -> D -> 0. 

By Lemma |A. II there exists an isomorphism 

det(D u ) ~ det(£> u © D ) © det(£>o)*- 

Tensor by (g) oi (eu6* i det(TL)*) u on both sides, 

C' u = det(Z> u ) ® (g)(e^det(rL)*) u 

~ det( J D u ffi J D )®det( J D )*(8)(5^)(e^det(rL)*) u . (8.7) 



Actually, we only need to orient 

£' u © det(Do) det(D u © £>„) © 6Z)(evb* ai det(TL)*) u , 



since the Cauchy-Riemann Pin boundary value problem 

D = (Z,u*Y c ,u*Y R ,yo,Do) 

determines a canonical orientation on det(L>o). Indeed, note that any real vector bundle 
over a Riemann surface £ with nonempty boundary admits a Pin structure because the 
second cohomology H 2 (T,) is trivial. So we can choose a Pin structure ^Po ° n u*Y — > £ and 
define tyo to be its restriction to u*Y R — >■ <9£. By the Lemma 2.11 in |So| . the canonical 
orientation on det(-Do) does not depend on the choice of ^Po- 
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Recall that the relative Pin structure on (X,L) gives a Pin structure on TL\ L (3) © 
V| L (3), and so gives a Pin structure on u\* dJ ,(TL © Vr). The notation is simplified since 

u e Q5. 

If L is orientable and given an orientation, we have induced orientations on u|g S (TL© 
Vr). Thus we consider the restricted Pin boundary value problem D u © Dq, the Proposi- 
tion [ATT] and the Remark after it ensures there exists a canonical orientation on det(Z^ u © 
Dq). Then the orientation of L gives the orientation of det(TX). Therefore, we provide a 
canonical orientation on the right-hand side of (|8.8[) . 

If L is non-orient able, on each boundary component (dT,) a such that k a ^ 0, choose 
arbitrarily an orientation on (evb* al TL) u . Still note that each boundary component (dT,) a 
has an orientation induced from the natural orientation on S. For each i £ [2, k a ] if k a ^ 0, 
we can obtain an orientation on (evb* ai TL) u by trivializing u\* dY TL along the oriented line 
segment in (dTi) a from z a \ to z a i. If for some a, u\^q^ TL is orientable, and if k a ^ 0, then 
the orientation on (evb* al TL) u induces an orientation on u\*^ d ^ TL] otherwise, if k a = 0, 
then we arbitrarily choose an orientation on u\*^^ TL. Thus for such a, ^l*^) (TL ©Vr) 
also has an orientation by choosing an orientation on Vr. Similar to the above argument 
u\q^(TL(BYr) admits a Pin structure given by the relative Pin structure on (X, L). Then 
the Proposition I A . 1 1 and the Remark after it still apply to D u © Dq, and det(D u (B Dq) has 
a canonical orientation. Hence we also provide a canonical orientation on the right-hand 
side of (|8.8p . Note that under the additional assumption (|8.5p . the choice of orientation 
on (evb* al TL) u is not important. Because changing the orientation on (eu6* 1 TL) u will 
change all the orientations on u\*^ d ^ (TL © Vr) and on (evb* ai TL) u , i S [2, k a ] it induces, 
by Proposition I A. II and Remark after it, the orientation on det(D u ©Do) will also change. 
Then the assumption ()8.5[) ensures that the number of orientation changes is even. So the 
orientation on the right-hand side of (j8.8|) is invariant. 

Note that the construction above varies continuously in a one-parameter family, we 
thus canonically oriented C'\-$. □ 

Proposition 8.1 Under the assumptions in Lemma \8.1[ the combination of the orienta- 
tions of L if it is orientable and the choice of relative Pin structure ^ on L provides a 
canonical orientation on £ , that is to say, there exists a canonical isomorphism of line 
bundles 

£^(g)evb* ai det(TL). (8.9) 

a.i 

Proof. It suffices to provide a canonical orientation for the fiber C' u over each u G B v = 
B\fi+i(X, L, d) such that it varies continuously with u. 

By definition the relative Pin^ structure gives a triangulation of the pair (X, L) . The 
map u : (X,<9£) — > (X,L) is nomotopic to a map u : (S,9E) — > (X^ 2 \ L^) by using 
simplicial approximation. The homotopy map is denoted by 

$ : [0,1] x (£,d£) (X,L). 

We will show that the choice of map $ is unique up to homotopy. Indeed, let $' be another 
such map. We can get a new map by concatenating $ and $' 

$#$'.•[-1,1] x (E,0£)->(X,L). 
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We can use simplicial approximation again to homotope to a map into the three 

skeleton (X^ 3 \ L^). By retaking suitable parameters, we get a homotopy map from <3? to 
denote it by 

[0,1] 2 x (£,£>£) 

satisfying 

*(0, t) = $(t), (1, t) = $'(t), 0) = u. 

That is to say $ is unique up to homotopy. 

On the other hand, the two maps $ and \& can be considered as maps from [0, 1] 
and [0, l] 2 to B v , respectively. Note that u G 33, by the Lemma 153] the relative Pin 1 * 1 
structure of (X,L) determines a canonical orientation of £'|g$. Then the orientation on 
£'|u induces an orientation of £'| u by trivializing Such orientation is the same as the 

one induced by any other homotopy since we can trivialize It is easy to see such 

induced orientation on £'\ u varies continuously with u. Therefore, C! admits a canonical 
orientation. □ 

The isomorphism (|8.9p doesn't involve the effect of the ordering of the marked points 
on boundary components. In fact, (X, L,d) consists many connected components, 

each one corresponds to each ordering of boundary marked points. Denote 

w = (wi, ■ ■ ■ ,w m ) 

where each w a is a permutation of the integers 1, • • • ,k a . We define the sign of w 

sign(ro) := ^sign(ro a ). (8.10) 

a 

Denote by the component of B^^ (X, L, d) in which z are ordered in by w. Now 
we modify the canonical isomorphism in Proposition 18.11 by 

Definition 8.3 When dimL ~ (mod 2) we define the canonical isomorphism to be the 
isomorphism constructed in the Proposition lff.il twisted by (— l) sl § n ( ro ) over the compo- 
nent d). Otherwise, we define the isomorphism to be exactly the isomorphism 
constructed in the Proposition lff.il 

Now we consider the orientation of moduli space of ^-stable maps. We will restrict 
attention to the special case: 1^-stable map of two components, one of which is from the 
original Riemann surface S, and the other of which is a disc bubble, no component is 
mapped into V; 

Recall that the domain is equipped with a marked layer structure (see Definition 17. 2|) . 
Similar to (|7.1|) . we can define associated operators on the layers A^, K > 1. 

Definition 8.4 A V -stable W 1,p -map is a map u G B^\^(Yi, X, L, d) together with 

(i) a marked layer structure on its (nodal) domain E with u\\ being V -regular, and 

(ii) for each K > 1, an element G ker defined on the layer Ak that is a section 
nontrivial on every irreducible component of Ak- 
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In particular, denote the space of ^/-stable W 1,p -maps with only the layer K = com- 
ponents by B^ p \ (£, X, L, d, 0), and denote the space of V-stable W 1,p -maps with only 

the layer K = 1 components by B^j (£, X, L, d, 1). 

We will give a description in more detail. Suppose that only one disc bubbles off the 
boundary component (<9£)j, along with k" of the marked points on (<9£)j, and I" of the 
interior marked points. The domain is a nodal surface 

£ = £ U D 2 /z' ~ 4' 

with |k'| + 1 boundary marked points and I' + 1' interior marked points on £, and k" + 1 
boundary marked points and I" + 1" interior marked points on D 2 such that 

k' = (&!,-•• ,k',--- ,k m ), k' = k b -k", 1 = 1' + 1 = 1' + 1". 

We denote by z'q (resp. z'q) the extra marked point on £ (resp. D 2 ) which is different 
from any z^, and also denote £' = !', I" = 1". Denote by 

B V * = B^ hg (t,X,L,d',d'',0) 

'■= ^k'+eliM'^' X ' L> d', 0) et ,^ x evb n B l k f^^ lll ^ ll (D 2 ,X, L, d", 0) 

the space of ^-regular W ,p stable maps with only one disc bubbling off and no component 
is mapped into V as above. The disc bubble represents the class d" G H2(X, L), denote 

d' =(d',d lr -- ,dm) <=H 2 (X,L)®H 1 (L) (Bm , 

satisfying d' + d" = d, d' b + dd" = d b , and e b = (0, ■ ■ ■ , 1, • • • , 0) is the vector with only the 
b th element equal to 1, others are zeros. 

In the notation of the W ' p space above, a C [1, and p C [1,/] denote the subsets 
of boundary and interior bubble off marked points, respectively. And q C [1, 1] denote the 
subsets of intersection interior bubble off marked points. 

We write the element u = (u',u") G Sj*,^ (S, X, L, d', d", 0), where 

u 'e B ' : = B iw,i-(^.M',0), 

u" G B" := fl^ I//)lw (£) 2 ,Jr, 1,^,0) 

such that 

eubo(u') = e-u6g(u"), 

where efftg (resp. evb'o) is the evaluation map at z'q (resp. z'q). For each such u G B v &, 
we denote by 

£ u := £ U L> 2 /4 ~ 4'- 

the associated domain curve. The stable map is u : (£, <9£) — >• (X, L), and the node of £ 
is denoted by zo- 

If we denote the two natural projections by 



Pi 



: B v * -> B', p 2 : -> 5", 
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then we can define the Banach bundle — > B v # by 

£# := pl£' (B p*£" . 

with fiber 

£* := L p (± u , U^iu^TX) © fl^iu'^TX)). 
For (J, v) G S v , we denote by 

(J,v) 

the section given by the ^-perturbed Cauchy-Riemann operator. The vanishing set of this 
section is the parameterized one-disc-bubble moduli space, denoted by 

(^))" 1 (°) =M^l„ Xe (t,X,L,d',d!',0). (8.11) 
Its vertical linearization is 

D# :=Dd* ,:TB V #^£#. 

Denote the determinant line bundle of family of Fredholm operators by 

C* :=det(D#)^B v #. 

Denote 

£#' = £# © (g)(evb* ai det{TL)*. 

a.i 

We define a subspace 

<B # := {(u,z,w,q) G B v * \ u : (±,d±) -> (X^,L^)}. 
We can obtain a lemma similar to the Lemma 18.11 

Lemma 8.2 The combination of the relative Pin^ 1 structure of(X,L) and the orientation 
of L if it is orientable determines a canonical orientation of 

Proof. It is similar to the proof of Lemma 18.11 and the arguments in Proposition 3.3 of 
|Soj . the modifications take place when we apply the Proposition IA.ll and the Remark 
after it to the two restricted Pin boundary value problems 

D' u ®D'o and £>„ © Pff . 

And we have an isomorphism 

det{D* © D*) ~ det(D' u © D' Q ) © det(Z^ © Dq) © CT&(5det(TL © Vfe)* . (8.12) 

□ 
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Using the same argument of homotopy uniqueness in the proof of Proposition 18.14 we 
can similarly obtain the following 

Proposition 8.2 The combination of the orientations of Lif it is orientable and the choice 
of relative Pirv^ structure ^ on L provide a canonical orientation on , that is to say, 
there exists a canonical isomorphism, of line bundles 

£*^(g)evb* ai det(TL). (8.13) 

a J 

In order to involve the effect of the ordering of the marked points, we also need modify 
the isomorphism in the Proposition 18.21 Recall from the proof above that the marked 
points on each (9S) a can be canonically ordered. So we can divide the space I? k '?(X, L, d) 
into components B^ p ^(T,, L, d). To be consistent with the isomorphism defined in Defini- 
tion l8.31 we can modify the canonical isomorphism (|8. 13|) and have the following definition. 

Definition 8.5 When dimL ~ (mod 2) we define the canonical isomorphism to be the 
isomorphism constructed in the Proposition \8.2\ twisted by (— l) sl s n ( ro ) over the compo- 
nent m (T,, L,d). Otherwise, we define the isomorphism to be exactly the isomorphism 
constructed in the Proposition \8.2[ 

9 Involution and sign 

Here the argument is different from the discussion by Ionel-Parker |IPlj for closed rel- 
ative GW-invariant, we must deal with the codimension 1 frontier of the compactification 
of the moduli space of the open V-regular maps. We will modify the original method by 
J. Solomon [So]. Note in the sequel we still assume L C\V = 

Let us then suppose there exists an anti-symplectic involution <j) such that L = Fix(0). 
And suppose £ is biholomorphic to its conjugation £, i.e. there exists an anti-holomorphic 
involution c : £ — >■ X. Fix (J, v) € jY. Thus, from the U-regular (J, i/)-holomorphic (resp. 
W 1,p ) map u : (£,<9£) i— > (X,L) we can define its conjugate ( J, i^)-holomorphic (resp. 
W ' p ) map u = 4> o u o c representing the homology class d = [u]. So we have an induced 
map 

4>' : B^(X, L, d) B>$J (X, L, d) 

given by 

u = (u, z, w, q) i-)- u = (u, (c| 9E ) |k| (z), c l {w), c e {q)). 
We denote the relevant Banach space bundle by £ — > B^ P ^(X, L, d) with fiber 

Su := LP{i:,n^ l {u*TX)). 

And we can similarly get a determinant line bundle of a family of Fredholm operators 
D :TB^{X,L,d) ^£ as 

£ := det(D) -> B^'J(X, L, d). 
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The evaluation maps can also be similarly defined 

evb ai : B^J^iX, L, d) ->■ L, i = 1, • • • , k a , a = 1, • • • , m, 

^ vi i '■ B k P i+i( X ' L,d) X, j = 1, • • • , Z, 
evi] ■ B i P l'+I( X > L ' a ) -> y > J = 1, • • • , 1, 

by 

ew6 ai (u) = u(c(z ai )), eui,-(u) = u(c(wj)), eWj(u) = u( c (<?j))- 
The total evaluation map is denoted by 

ev := evbai x ei>ij x 

5v : ^(X, L, d) -> Ll k l x X' x (9.1) 
Moreover, we can define a map 

£ i— >• cZ</> o £ o dc 

covering 0'. Also $ induces a map VP : £ — > £ covering (j)'. Denote by 

£' := £ ® (g) eu6^det(TL)*. 

a,i 

Thus, \P also induces a map 
covering 0'. 

From the Proposition ^. H and Definition ^. 31 we know that both £' and £' have canonical 
orientation. So the map may either preserve the orientation component or reverse the 
orientation of some connected components. We say the sign of \P' is if M/' preserves 
the orientation of £' to that of £', otherwise, we say the sign of \T/' is 1. The following 
proposition shows an expression of the sign of VP'. Recall go denotes the genus of £/<9£, 
and dimL = n. 

Proposition 9.1 If L is relative Pin~ , then the map VP' has sign 
u(d)(u(d) + 1) N , „ , , „ 

+^2 (V) ) + u»i (u*TL) + u»i (u*TL) {d a ) Wl (u*TL) (d b ) 

a<b 

+ ^ Wl (u*TL)(d a )(k a - 1) + ( n + 1) ^ (fca ~ 1} 2 (fca ~ 2) mod 2. 
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If L is relative Pin + , then the map \P' has sign 

5 - ^ M<OM<0 + 1) + (1 _ gQ)n + nm + deg s + |k| + / + g 

+w 3 (V)(^(d)) + wi (u*TL) {d a )w\ (u*TL) (<Z&) 

a<b 

+ J2Mu*TL)(d a )(k a - 1) + (n + 1)^ ( *" ~ 1} f a ~ 2) mod 2. 

a a 

Where tp : H*(X, L; Z/2Z) — )• H Jf (X;7j/27j) is a degree homomorphism defined in ]So^ . 

Since the proof of the preceding proposition is similar to the proof of the next one and 
we will not actually use it, we do not show the proof here. 

Sometimes, for simplicity, we would denote n = n(d), W2 = ^(V) and w\ = w\(u*TL) 
if no danger of confusion. 

Corollary 1 7/dimL < 3, then we always have 

s - ^ Kv + 1 ) + ^ _ go ) n + nm + deg s + | k | + 1 + 1 

+ y~]w 1 (d a )w 1 (d b ) + y^w 1 (d a )(kg - 1) 

a<b a 

+(n + l)^ ( fc "- 1 )( fc "- 2 ) mod 2 . (9.2) 



In particular, if £ = D 2 , we have 

s = 

2 



+ deg s + |k| + / + I + n(k - 1) 



, (k- l)(k-2) , . 

+(n + ip ^ ^ mod 2. (9.3) 

Proof. When dimL < 3, the Wu relations imply that L is Pin~, we can take the standard 
Pin~ structure. Note that u>2(V) = and w\(dd) = fi(d) mod 2, thus the formula is 
simplified. □ 

Then we define and calculate the sign of a map related to the boundary of moduli 
space. Recall that 

:= ^k'+elS',!'^' ^' ^' tyevb' x evb'J By?^,, j„ (D 2 , X , L, d" , 0) 

Note that the standard conjugation c : D 2 — > D 2 gives a biholomorphic isomorphism 
D 2 ~ D 2 . Then from the involution cj), we just have an induced map 

0b» ■ B^l v , v ,{D 2 ,X,L,d",ti) -> Bl;f^ llir (D 2 ,X,L,df',0) 

of the second factor of the fiber product. Then since L = Fix(^), <pB" induces an map of 
the whole fiber product 

: B v * -> B v # 
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^SmA x > l ' d '' d "> °) B &Z,i,A x > L > d '> d "> °)- 

We denote the relevant Banach space bundle by 

And we can similarly get a determinant line bundle of a family of Fredholm operators 
D : TB V * -> £# as 

£# := det(5) -> ^; p ;^^(S,X,L,d',(f',0). 
The obvious evaluation maps are denoted by evij, evb a i, eviy Denote by 

£#' : = £# ^ evb* ai det{TL)*. 

a.i 

Similarly, we have induced map covering c/> R #. Recall that the inhomo- 

geneous term 1/ vanishes on bubble components, so it is (^-invariant. Therefore, oTj v \\s* 

and dfjJg# are two B # — equivariant sections. Consequently, B # and induce 

a map of determinant line bundles : — > covering (f) B # . Thus, also induces 
a map 

: £#' -> £#' 

covering </>g#. If this map preserves orientation the sign of it is 0, otherwise the sign is 1. 

Remark. If the homology class d represented by u is (^-anti-invariant, that is, the stable 
map u is real, then all the maps above are involutions of their respective objects. In 
particular, we only define and calculate the sign 

For stating the formulae for the sign of , we introduce some new notation. Let 

T«(d", k") fi{d")k" Wl (dd")k", (9.4) 



T^\d' b ,d",k',k") 



( 0, toi^) =wi(0d") = O. 

fe', w 1 (cf 6 )=«;i(ad") = l, 

fc" — i, wi«) = i, wi(ad") = o, 

k k' + k" -1, Wl {d' b ) = 0, wi{dd") = 1. 



(9.5) 



Proposition 9.2 flj Suppose the marked point z b \ does not bubble off, i.e. 1 j£ cr. XTien 
i/ie map /ias sign 



5 ± 



M (d")(M(0±l) 



degs" + ife" + l + Z" + f" 



+™ 2 (V)(V>(cf)) + T (1) (d"^" 
fc"(V — 1) 



(9.6) 



+ n + 1 



mod 2, 



with + in i/ie Pin + and — in the Pin case. 
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(2) Suppose the marked point Z\,\ bubbles off, i.e. 1 £ a. Then the map has sign 

5 * {2) = Kd, ' ) ^f )±1) +de g ,'' + k'' + l + f + i'' 

+w 2 (V)md'')) + T^Hdld n ,k',k , ')+wM)Mdd'') (9.7) 
+{n + l)[ {k " ~ l) t k " ~ 2) +h{k" + l)} mod 2, 

with + m the Pin + and — in the Pin~ case. 

Remark. If L is orientable and dimL = n is odd. Note the fact that if L is orientable then 
n(d") is even , so wi(d' b ) = w\{dd") = 0, we have 

s #(l) = s #(2) = s #(3) = fi #(4) 

+degs " + A;'' + i + z" + r + u, 2 (V)(V>(d"))- (9-8) 

Proof of Proposition \ 9.2\ The first two terms in s± come from the formula (|A.7p . It 
is the sign of the conjugation of the determinant line associated with the restricted Pin 
boundary problem D'^ © Dq appearing in (|8.12p . induced from the conjugation on the 
moduli space of unmarked discs. The terms k" + 1 + 1" + £" account for conjugation on the 
configuration space of marked points, satisfying an extra incidence condition. The term 
W2(V)(ip(d")) accounts for the change of orientation of the determinant line det(-D„ ®Dq) 
arising from the change of Pin structure induced by the involution <f>. Recall that the 
unique oriented path from z ^ zq to z' in the boundary of <9E, induced by the complex 
structure of S, is very important for determining the canonical orientation of . This 
path will reverse under conjugation. The terms (resp. T^ 2 ) + w\(d' b )w\(dd")) in 
(resp. s**- 2 ^) reflect this dependence. Note that reordering of the boundary marked points 
will affect the isomorphism in Definition 18.51 when the dimension of L is even. The last 
terms account for this dependence. □ 



10 Equivalent definition of relatively open invariants 

Recall from (|8.2|) that we have the parameterized moduli space of ^-regular maps 
.M^j(X,L,d), then we can use the method by Solomon to give a modified definition of 
the nonparameterized moduli space which is a section of the reparameterization group 
action. For instance, suppose E = D 2 and I > 2. Let 

(u, z,w,q) i y Wj 

be the projection to the j th interior marked point. Take an interior point o~o £ D 2 and a 
line £ C D 2 connecting o~o to dD 2 such that for any pair of points (w, w') £ S x E there 
exists a unique ip £ Aut(E) ~ PSI^R) which satisfies 

<p(w) = o-q, tp(w') £ £. 
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Denote the distance function on D 2 by d(-,-). Then we impose on the inhomogeneous 
term v the condition 



U(; ; (W 1 ,W 2 )) = , , , > (-, •> Wy 2 ))- (Id) 

Then we can define the nonparameterized moduli space as 

Ml^(X,L,d) : = (tti x TTs)" 1 ^ x £) C jw£j(X,L,d). (10.2) 

For general S, the nonparameterized moduli space can be similarly defined. Moreover, if 
there is no ^-multiply covered maps with non-positive Maslov index, the standard transver- 
sality arguments show that for a generic choice of (J, v) under some constraints like (jlO.lj) . 
M^j(l,I,d) is a smooth manifold of expected dimension. We will not show all con- 
structions here and refer to |Soj for an explanation of condition (|1Q. 1 j) and the similar 
constructions of nonparameterized moduli space of pseudoholomorphic (non-relatively) 
open maps in other cases. 

From the discussion before, we see that we have two moduli spaces of ^/-regular maps 
•M k ', \(X, L, d) and, corresponding to the anti-symplectic involution (j), «M k ', \(X, L, d). 
And we can restrict the two total evaluation maps (|8.3p and (|9.ip to have 

ev : M^(X,L,d) -> L |k| x X 1 x V e , 



ev : M^%X,L,d) -> x X* x V t '. 

For generic choice of points x = (x a j), x a j G L, and pairs of points y + = (y^), V- = (yj) 
such that y~t = 4>{y~), j = 1, • • • ,/, and q + = (q^), q_ = (Qj) such that q+ = </>(qJ~), 
q^ G V, j = 1, • • • ,1, the two total evaluation maps will be transverse to 

n x n vt x n ^t &nd n ^ x n y 7 x n ^ 

a,i j J a,i j J 

in L' k ' x X 1 x V^, respectively. For defining invariants, by index theorem, the following 
dimension condition would be satisfied 

(n - l)(|k| + 21) + (n- 2) • U = n(l - 5) + - 2degs - dim Aut(Z), (10.3) 

where : H2(X,L) — > 7L denote the Maslov index, g denote the genus of the closed 
Riemann surface X Ugs £ obtained by doubling S. Note that fi(d) = /i(d), we can define 
a number as 

M(F,d,(/),k,/,l) =#ev- 1 (x,y + ,q+) + #eV~ 1 (f,y_,q_), (10.4) 

where # denotes the signed count with the sign of a given point, for example u G 
ev _1 (f, y + , q+), depending on whether or not the isomorphism 

<fev u : det(TA^J(X, L, d)) u ==> ev*det(T(L |k| xl'x V e )) u 



60 



agrees with the underlying canonical isomorphism appearing in the Theorem ll.il 

det{TM^(X, L, d))=» (g) evb* ai det(TL), 

a,i 

up to the action of K + . 

In particular, if d = d we just simply define the number 

^/K := M^¥{V, d, k, I, I) = M(V,d,(j),k,l,l) = #ev" 1 (x, y, q), (10.5) 

where (x, y, q) is a real configuration, i.e. I = 2c, y = {yf,--- ,yt iV\ " iVc} satis- 
fying Vf = 4>(yJ<), f = I,"" > c ; and 1 = 2c, q = {q+,--- ,q£,qi~,--- ,q^} satisfying 

qy = <Kq/)> / = !,••• ,<E- 

Remark. For such special d E H2(X,L), we can prove that is an invariant if L is 

orientable and dimL < 3 or if L might not be orientable and dimL = 2. However, for 
general homology class d, we might not expect that M(V,d, <^>,k, l,T) is invariant. In the 
sequel, we will construct invariants for general homology class d, the proof of invariance of 
3£jY(y, d, k, 1, 1) can be considered as a special case of the proof below of the invariance 
of more general invariants. 

In order to define relatively open invariants for general homology class d £ H2(X,L), 
let us introduce more necessary notations. We denote by <d = dc the doubling of d. For 
any homology class j3 £ Hi (X, L) , denote 

p=(p,px,--- , P m ) £ Hi(X, L) © Hi{L)® m , 

and we denote the set of (k, I + l)-real configurations by 1Z := lZ(x, y, q) which is 

f f = (x,£,A ) = (xii,-- - ,x m fc m ,6) ■ ■ ■ ,Ai) 

I Uj = or = 2/7' i = ^ " ■ ^; a j = q| or a j = j = i, • • • » l - 

Moreover, denote by ev^^ the total evaluation map 

ev (/3,0 = M^(X,Lj) -> L' k l x X 1 x 

(■u, iu, i— )• (x = u(z),^ = u(w), A = u(q)). 
Now, we can rewrite the number of (jl.4p as 

X:=X xi ffi 9 ,d,k,«( f '^ ( q) = 2 #ev-^(x,£X ) (10.7) 

V / 3:/3 c =d;VrG7e 

To show that the definition (|10.7|) is independent of the choices of x and pairs (y+, y_), 
(q_l_,q_) is equivalent to proving the expression (|1.4p is independent of the choices of 
det(TL)-valued n-forms a a i, pairs of 2n-forms and pairs of (2n— 2)-forms (77+, 77"), 

where 7^ represent the Poincare dual of for j = 1, ■ ■ ■ , I, and rf^ represent the Poincare 
dual of q^ for j = 1, • • • , 1. 
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11 Proof of invariance 

In the following, for the special case L n V = 0, we will show that the numbers 
I (in particular, MjV) are invariants, provided L is orientable and dimL < 3, if L is 
nonorientable, we suppose that dimL = 2 and the number of boundary marked points 
satisfy some additional conditions. 

Suppose that we are given different points of real configuration {x 1 ', i/±, q'±) satisfying 
the same generic conditions. 

Let us denote 

x : [0, 1] -> L |k| , x(0)=x, x(l)=a?, 

y ± :[0,l]^X l , y+(t) = 0(y-(t)), 

y ± (0) = y±, y ± (l) = y' ± , 

q^l]-^, q+(i) = 0(q-(t)), 

q ± (0)=q±, q ± (l) = q'±, 

E:[0,1]->X\ 3(0) = £ 3(1) = 

A:[0,l]->^, A(0) = A, A(1) = A', 

moreover, we require that £j = (resp. yj) if and only if £J = (resp. Aj = q+ 

(resp. q~) if and only if A^ = q^ 4 " (resp. q^ - )- Denote the set of all paths by 

R:=R(x,y ± ,q ± ) = {(x,E,A)} 

And denote 

W(x,H,A,/3) :=Ml^(X,Lj) eV{M x (xxSxA)oA ([0,1]), (11.1) 

W = W(x,y ± ,q ± ,d) := \J W(x,3,A,/3). (11.2) 

P ■■ Pc = d, 
(x,E,A)eR 

Note that W gives a smooth oriented cobordism between 



U ev (^(^^^) 

V/3:/3 c =d;V reR(£,iT,3) 

and 



U %W xW,) - 

V/3:/3 c =d;V P €1Z(x' ,y' 

Since in general W is noncompact, in order to prove the invariance of X : = X x \ s g 
we must research the stable boundary c^W arising from the Gromov compactification of 
W. 

Note that for any tuple P = (/?, /3i, ■ ■ ■ , P m ) £ H 2 (X, L) © Fi(L)® m the boundary of 
^/-stable compactification is 

dM^X, L, P) := MZ]* l>p>l J±, X, L, P', P", 0), 
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where ft' = {ft',fti,--- ,ft' b ,--- ,/3 m ), ft' = ME)], 0" = M^ 2 )] G H 2 (X,L), such that 
/3 = + 5/3" + ft' h = ft. 

In fact, the moduli space -M^-ai p i gi^- 1 ' ^, L, ft', ft", 0) can also be redefined as a section 
of the reparameterization group action on the parameterized moduli space defined in 
(|8.11|) . The constructions of these moduli spaces are also relative versions similar to those 
constructed in [So]. For instance, suppose that S — D 2 and I > 2. Note that v = on 
bubble components, thus there exists an action of PSL 2 (M) on the parameterized space 
(|8.1ip given by 

(u', (u", z", w", ?)) -+ (W, (u" o V,, tyr 1 )*"*", (iT 1 )' V, (V^Y'V')), 
where ip G PSL 2 (R). Let 

be the projection to the point where the bubble attaches. Then if w' does not bubble off, 
similar to f j 1 . 2 j) we can define the nonparameterized moduli space as 

M%* ltt ,i e (Z,X,L,P',p f ',0) := (tti x TT 2 r\<j x £)/PSL 2 (R) 

C M^ lpl jt,X,L,ft',ft",0)/PSL 2 (R), (11.3) 

Otherwise, if it/ bubbles off, we can define 

MZl® M j£,X,Lj',/3",0) := (tti x ^ )~Vo x (£ n dE))/PSX 2 (R). (11.4) 

For another special case that S ~ D 2 and Z = 1, the moduli space can be defined as 
follows. We first choose a (^-anti-invariant pseudo-cycle (A, f) representing the Poincare 
dual of the symplectic form oj. Then taking M^^ 2 p j e (S, X, L, ft',ft",0) as defined above, 
we can perturb (A, f) slightly so that the evaluation map 

e ^2 : M^ Me {% X, L, ft', ft", 0)^X 

is transversal to (A, /). Thus, we define 

K:; Me (±,X,Lj',ft",0) := ^Ml : ; Me (%X,L,ft',ft",0) x x A. (11.5) 

Note from the lemma 4.4 of [So] that one can choose the pseudo-cycle (A, /) which does 
not intersect L. 

For simplicity, denote 

M(z) = Ml',* ebtl , tV (i;,x,L,ft>,o), 

M{D 2 ) = M V ^l irr (D 2 , X, L, ft", 0). 
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Then 

dj%£{x,Lj)) = mZi; m j%x,lJ',p",o) 

= M(Z) evb , o x evb ,,M(D 2 ). (11.6) 

We can generically choose (x, y ± ,q ± ) such that (x, H,A) = [x, (E',5"), (A', A")] S R 
is transverse to the total evaluation map 

ev (/3 , +/3V1 : M^ WtB (t,X, 1,^,^,0) -J- LW xl'x K 

We denote by 

(H-7) 

:= ■^k,V,Z,/ } ,l, e ( S '^"'- C '" 8/ '^"' ) ev C/3'+^",rO x [xx(H',H")x(A',A")]oA [0, 1] 
the boundary stratum of the cobordism W arising from Gromov compactification. Denote 

■■= boKm w( s "> A ") u d G wi^ 

and 

d GW*,P,9 = U d cKp,e, W ■ 

/3', (3": (/3' + /?") c = d 

Thus the total Gromov compactified boundary of W is 

d G w= y (n.8) 

6 e [l,m],a c [l,fcf,], 
pc[i,(Uc[i,l] 

Then we have an induced involution map on the boundary of cobordism 

OgKp, s , w(S",A") fcy^ ^, + ~(^(E'0^(A")). 

We claim that this map is fixed point free. Indeed, a fixed point of (j)g can only be in 
the strata satisfying f3" = f3". And we assume that there is no nonconstant </>- multiply 
covered pseudoholomorphic disc. Since a 0-somewhere injective disc can not be a fixed 
point of 4>q, the fixed point of <j)g could only be the map that a zero energy disc bubbled off. 
The process of such bubbling-off corresponds to an interior marked point moving to the 
boundary. However, from the definition (| 1 1 . 5 1) of moduli space we know that the marked 
point constrained away from L can not move to the boundary. So the contradiction implies 
that <fig has no fixed point. 

We below will show that (j)g is orientation reversing if 

(i) L is orientable, dimL = 3; or 
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(ii) L might not be orientable, dimL = 2 and if L is nonorientable we require the 
condition (|8.5p is satisfied. 

• Case (i). L is orientable and dimL = 3 

Since dimL = 3, by Wu relations, L is Pin~ , so = 0. Since L is orientable, 

li{d") is even. Note the assumption L n V = 0. Therefore, by the formula (|9.8p . the sign 
of can be simplified as 

s # = ^p- + degB" + k" + l + l" + £" mod 2, (11.9) 
Moreover, from the definition of the moduli space above we can see that the map 

^* ■ K:*,i, P> i,A l, p>, /?", o) -+ M%; u>he {% x, l, w, o) 

has the same sign. 

Note that the involution <f> acts on X reversing the orientation since ^*w 3 = — w 3 . So 
4>d acts non-trivially on /" of the factors of X 1 . Therefore, the sign of the map between 
the two fiber products 

<Pd : d G W h a ^ 0l+ p„(Z",A") -+ d G W b a ^ p , +Wl {m"U{M')) 

should be independent of I". 

On the other hand, let us consider general dimension n = dimL for the moment. Recall 
(|5.3p the virtual dimension of ^/-regular moduli space is 

^M^%^(X,Lj) = n(p)+n(l-g) + \k\ 

+2(1 + £- degs) - dimAut(T,). 

The definition of invariants requires the following dimension condition 

fi(P) + n(l - g) + |k| + 2(1 + £ - deg s) - diim4ut(£) = (|k| + 2l)n + 2t(n - 1). 

So we have 

p(fi) = (|k| + 2l)(n - 1) + 2£(n - 2) + 2 deg s - n(l - g) + dimAiri(E). (11.10) 

We observe that if we restrict the evaluation map to L fc "x^"x^",the image should 
be at least codimension one to have a nontrivial intersection. That is 

&imM(D 2 ) = n + fi(f3") + (k" + 2l") + 2(£" -deg$")-3 

> (k" + 2l")n + 2£"(n - 1) - 1, (H-H) 

therefore 

fi((3") > (k" + 2l")(n - 1) + 2£"(n - 2) + 2deg$" + 2-n. (11.12) 
Similarly, we have 

diiaM(E) = n(l -g) + fjt(P') + (k! + 21') + 2(£' - deg s') - dirm4«i(£) 

> (k' + 2l')n + 2£'(n- 1) - 1, (11.13) 
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and so 

fi(0') > (k' + 2l')(n- 1) + 2£'{n-2) + 2deg$' 

+ diim4ui(£) - 1 - n(l - g). (H-14) 

Then from (|11.1U|) and (|11.14p we have 

/i(/3") = m-ntf) 

< (A;" + 2/")(n-l) + 2£"(n-2) + 2degs" + l. (11.15) 

In particular, when n = 3, from (|11.12|) and (|11.15|) . and noting that is even, we 

see that each set dc^V^ (""> A") ^ s nonempty if and only if the following dimension 

condition is satisfied 

fi(P") = 2{k" + 21") + 21" + 2deg$". (11.16) 

Thus we have 

a(B") 

signed) = t=2L± + deg s" + k" + 1 + t" = 1 (mod 2). 

That is to say, the map (j)g reverses orientation. That means ^<9gW = 0. Therefore, we 
have 



So integers 1^* d k z are independent of the choice of (x, y, q). Equivalently, we can 
say that the integral in (|1.4|) is independent of the choices of a a i, jj and r\ r Similarly, 
we can prove that I x ^ s g d k ; are independent of the generic choice of J G ^,0, and the 
choice of inhomogeneous perturbation v £ "P^, c - That means ^x^gdkz are invariants of 
the tuple (X, w,V, 0). In particular, if d = d, the numbers £%JY = M(V, d, </>, k, 1, 1) in 
(|10.5p are also invariants for this case. 

• Case (ii). dimL = 2, and (|8.5p is satisfied if L is not orientable 

Also by Wu relations, L is Pin" , so ^(V) = 0. As the argument above, we conclude 
that the sign of the map <$ft is given by formulas (|9.6p and (|9.7p depending on whether 
or not 1 £ a. Since (p*uj 2 = uj 2 , (j) preserves the orientation of X. It means that (|9.6p and 
(19. 7p also coincide with the signs of the map 4>q. Then by inequalities (|11.12p and (|11.15p . 
note n = 2, we see that the stratum dcW^ p g p pn will be empty unless 

H(J3") + r = k" + 21" + 2 deg s" (11.17) 

for r = or — 1. The following calculation shows that the signs (|9.6p and (|9.7p are exactly 
1. 
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First, assume 1 j£cr. Using the restriction (|11.17p . we have 
k"(k" - 1) (fi((3") + r - 21" - 2 deg s") W) + r- 21" - 2 deg s" - 1) 

a rigKgg) - 1) + rfe-li 2 + ,„ + degs „ + (mod 2) (n lg) 

Also from ()11.17j) . we have 

X « (/?", k") * n(f3")k" * fi(p") 2 + rfi(J3") + 2(l" + deg s")/i(/9") 

^(/3") 2 + r/x(/3") (mod 2). (11.19) 

Substituting (111.171) . (111.181) and (111.191) into (j9"U|) . we have 



(mod 2). 

Also note that when n = 2, the involution <fi acts on 1 dimensional submanifold V reversing 
the orientation since 4>*u = —oj. So 4>g acts non-trivially on I" of the factors of V . 
Therefore, the sign of the map between the two fiber products 

<t>a : oqKm ^+^(e",a") -+ d G w b a ^ p)+w xm")Am) 

should be independent of I" . Thus we have 

r(r + l) 

signifo) = — - + 1 = 1 (mod 2) 

since r = or —1. 

Then we consider the case 1 € a. Using the restriction (|11.17p again, we have 

(fc"-l)(fc"-2) (fi((3") + r - 21" - 2 deg a;" - \)W) + r- 21" - 2 deg s" - 2) 

2 2 
^ M^WQ + l) r(r + l) 
2 2 
+/" + degs" + r / u(/3") + l (mod 2). (11.20) 

Recall the condition (|8.5j) : u>i(/3ft) = kb + 1 and (|11.17|) . we calculate 

fc fe (fe" + l)^(u; 1 (/3 b ) + l)(M/3") + ^ + l) (mod 2). (11.21) 
Substituting (I11.17p . (I11.2()|) and (lll.2ip into ([El), noting that r = or -1, we have 

+(wx(p b ) + + r + 1) + T< 2 > + Wl {p' b ) Wl {dp") 

* r/i(/3") + r + £" + ( Wl (&) + 1) M/3") + r + 1) 

+T (2) + wi(/?^i(<9/?") (mod 2). (11.22) 
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Recall the formula (|9.5p and the fact 

Wi(P b )=w 1 (%) + w 1 (dP"), 

we can express 

T (2) = wi{p b ){k" - 1) + Wl (dp")k'. (11.23) 
Considering the fact that — wi(d/3") (mod 2), and using (|11.17p and (|8.5|) . we obtain 

Wl {dp")k' * Wl {dp"){k b -k") 

* Wl (df]")(MM + i + ^" + r)) 

^ w 1 (dp")w 1 (/3' b ) + »(P")(l + r) (mod 2). (11.24) 
Substituting (lll.24|) and (|11.17l) in (|11.23D . we get 

T< 2 ) Wl {p b )W) + r + 1) + ^(S^O^lO^) + A*(/3")(l + (mod 2). 
Substituting the last formula in (|11.22p . we calculate 

S 2) = r/i(/3") + r + l" + W) + r + 1) + (1 + r) 

^ £" + 1 (mod 2). (11.25) 

As the mentioned reason above, the sign of <f>g is independent of £", so sign(<j)g) = 
1 (mod 2) , which implies 1^^* d k ; are invariants of the tuple (X, w, V, <ft). In particular, 
the numbers £%JV = M(V, d, 0, k, 1, 1) in (|10,5p are invariants of the tuple (X, us, V, 4>). 

Appendix 

For the convenience of the reader, we review some definitions and important conclusions 
in [Soj about the orientation of determinant of real linear Cauchy-Riemann operator. For 
our concrete problem of intersection of stable maps with a codimensional two symplectic 
submanifold, we state that similar conclusions hold for some kind of restriction of Cauchy- 
Riemann operator. 

We denote by T an appropriate Banach space completion of the smooth section of 
a vector bundle. For a vector bundle V — > B, we denote by 3(V) the orthonormal 
frame bundle of V which is a principal 0{n) bundle. Recall the fact that the Lie group 
Spin(n) is the central Z/2Z extension of the special orthogonal group SO(n), similarly, the 
two groups Pin + (n) and Pin~(n), although are topologically the same, are two different 
central extensions of 0(n). 

Definition A.l A Piri^(n) structure ^3 = (P,p) on a vector bundle V — > B consists of 
principal Pm ± (n) bundle P — > B and a Pm ± (n) — 0(n) equivariant bundle map 

p:P^$(V). 

A map (p : V — > V between vector bundles with Pin structure preserves Pin structure if 
there exists a lifting (p such that the following diagram commutes 
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p — £ — »p> 

p p' 



3(V) * . $(V>) 

The obstruction to putting a Spin structure on a bundle V — > B is (X) £ H 2 (B, Z/2Z). 
For Pin + it is still ^(V), and for Pin~ it is 102 (V) + tof (V). 

Definition A. 2 Let (E,<9£) 6e a Riemann surface with boundary <9£ = LI^Li(<9E) a . A 

Cauchy-Riemann (or Riemann- Roch) Pin boundary value problem 

D = (X,E,F,%D) 

consists of 

1° a complex vector bundle E — > £, 

2° a totally real sub-bundle over the boundary F — > dT,, 

3° a Pin + or Pin~ structure *P on F, 

4° an orientation of F\^) a for each a so that F\^g^ a is orientable, 
5° a differential operator 

D:T((J:,dJ:),(E,F))^T(J:,n '\E)) 

such that for f G C°°(E,R), £ G r((S, (£7, i?)), 

£>(/£) = 

D is called a real linear Cauchy-Riemann operator. 

Remark. For the sake of studying the (J, ^)-holomorphic maps relative to a codimensional 
2 symplectic submanifold V C X, say V-regular maps, we may consider the restriction of 
a real linear Cauchy-Riemann operator D to a subspace r res * := rV r)S )((£, dT,), (E, F)). 
A section £ G r res * (or r( r ffi )) if and only if it satidfies some vanishing conditions at each 
prescribed (say, intersection) marked point p ai (resp. q 3 ). In the present paper, we only 
consider the orientability of moduli space under the condition LdV = 0, thus we denote 
the subspace simply by T rest or T s and the restriction of D to this subspace by D rest or 
D s . In particular, for the concrete case of moduli space, D s is the restriction by contact 
condition of D u = D u 3(j^, where u G M v (X, L, d). When the pair (J, v) G I v (or jY) is 
^-compatible (see Definition 14. ip . the arguments in Lemma 15. II show that the restriction 
is transverse. Therefore, in such concrete situation D s is D u for u G A4Y (X, L, d). 

It is not difficult to apply the arguments by Mcduff-Salamon (see |McSj Appendix 
C.2 ) to show that D rest is a Fredholm operator. We call D rest = (E, E, F, «£, D rest ) the 
restricted Pin boundary value problem. 

For a Fredholm operator D, we define its determinant line by 

det(D) := A max (ker D) ® A max (coker D)*. 
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As explained in [McSJ, for a family of Fredholm operators, det(D) denotes a line bundle 
with the natural topology. 

Since we may trivialize E over E and each component of boundary (<9E) a — S , the 
restriction of F to each (<9E) a defines a loop of totally real subspaces of C n . it is well 
known such a loop associates a Maslov index u a . we denote by 

m 

fi(E,F) = ^2^ a (A.l) 

a=l 

the total Maslov index of the vector bundle pair (E, F). Moreover, ji(E, F) doesn't depend 
on the choice of trivialization of E. 

We say ip : D — > Ff is an isomorphism of Cauchy-Riemann (or restricted) Pin bound- 
ary value problems if 

i) there exists a biholomorphic map / : E — )■ E'; 

ii) there exists an isomorphism of bundles ip : E — > E' covering / such that ip\dT, maps 
F to F' and preserving Pin structure and preserving orientation if F, F' are orientable; 

iii) (p o D = D' o (p. 

J. Solomon showed the following (Proposition 2.8 and Lemma 2.9 in [Soj) 

Proposition A.l The determinant line of a real-linear Cauchy-Riemann Pin boundary 
value problem D admits a canonical orientation. If ip : H' ^ s an isomorphism, then 

the induced morphism 

^ : det(D) det(D') 

preserves the canonical orientation. Furthermore, the canonical orientation varies contin- 
uously in a family of Cauchy-Riemann operators. That is, it defines a single component 
of the determinant line bundle over that family. If the boundary condition i ? |(9s) Q ^ s ori- 
entable, then reversing the orientation on i ? |(gs) a will change the canonical orientation on 
det(D). 

Remark. It is not difficult to apply the method of proof by Solomon to generalize the 
Proposition above to the case for the restricted Pin boundary value problem p rest . For 
instance, it is important in the proof of Proposition 2.8 in [So] that, for any chosen Cauchy- 
Riemann operator D on the restriction i£|g, det(L>) has the canonical complex orientation, 
where E — > £ is the degenerated vector bundle of E — > S, S = E U a A a (E is the closed 
component, A a is a disk corresponding to each (<9E) a ). In our relative case, we consider 
the restriction D rest which is a complex Fredholm operator, and det(D rest ) also can be 
equipped with the canonical complex orientation. The remain arguments in the proof of 
Proposition 2.8 in |Soj can go through with minor modifications. 

We then come to study the sign of conjugation on the canonical orientation of the 
determinant line of a Cauchy-Riemann (or restricted) Pin boundary value problem. More 
precisely, given a Riemann surface E, let E denote the same topological surface with 
conjugate complex structure, and let 

c : E E 
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denote the tautological anti-holomorphic map. Similarly, let (E, F) denote the same real 
bundle pair with the opposite complex structure on E, and denote by 



C : E -> E 

the tautological anti-complex-linear bundle map. Furthermore, a Cauchy-Riemann (resp. 
restricted) operator D (resp. D s ) on the bundle E — > £ is the same as a Cauchy-Riemann 
(resp. restricted) operator D (resp. D s ) on the bundle E — > £. So, given any Cauchy- 
Riemann (resp. restricted) Pin boundary problem D (resp. D s ), we may construct its 
conjugate D (resp. D s ). Clearly, we have a tautological map of Cauchy-Riemann (resp. 
restricted) Pin boundary value problems 

C:D^D (resp. D$ -> D^). 

Suppose the genus of is go, the number of boundary components of £ is m and 

rank(F) = n. Denote by fi = u(E, F) and by w\ the first Stiefel- Whitney class. Solomon 
calculated the sign of the induced isomorphism ^> : det(D) —> det(D) (Proposition 2.12 in 

Bol). 



Proposition A. 2 The sign of the induced isomorphism ^ relative to the respective canon- 
ical orientation is given by 



sign + (D_) 



for a Pin + structure and 



+ (1 — go)n + ran 



+ ^w 1 (F)((dZ) a )w 1 (F)((dZ) b ) mod 2, 



(A.2) 



a<b 



sign (D) 



+ (1 — go)n + Tnn 



+ J2MF)(m) a )w 1 (F)((dZ) b ) 

a<b 
m 

+ X>(F)((0£) a ) 



mod 2, 



(A.3) 



a=l 



for a Pin structure. In particular, when £ = D 2 , go = and m = 1 we have 



sign^ 1 (D) 



m(m±i) 



mod 2. 



(A.4) 



As to our concrete case of regular maps, for the restricted Pin boundary value problem 
D s , we study the sign of the induced isomorphism \& : det(D s ) — > det(-D s ). Recall that 
when the pair (J, v) £ § v (or jY), we can consider D ffi = D u for u £ .Mg (X, L, d) , where 
$ = (si,-- - , s\) is the list of multiplicities of interior intersection points of a ^-regular 
map, and deg $ = X^-J=i s r The argument is a modification of the one of Proposition 2.12 
in |Soj . involving the interior contact conditions. Basically, one need modify the formula 
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(9) in [So] respecting to our concrete case of ^-regular (J, i/)-maps for generic (J, v) G F, 
the transversality of contact conditions (see Lemma 15. ip implies the relation 

index c (Z) ffi ) = index c (£>) - deg s, 

where D s is the restriction of the chosen complex Cauchy-Riemann operator D on the 
restriction E\j,. Thus, we have 

Proposition A. 3 The sign of the induced isomorphism : det(D s ) —> det(D s ) relative 
to the respective canonical orientation is given by 

sign + (D s ) = ^f_tll _|_ ^eg $ + (1 — g )n + mn 

+ J^«;i(F)((5E) a )«Ji(F)((SE)6) mod 2, (A.5) 



a<b 



for a Pin + structure and 



sign (Ds) = ~ + deg s + (1 — go)n + mn 



+ Y,MF)((dZ) a )w 1 (F)((dZ) l 



a<b 
in 



+ J2w 1 (F)((dE) a ) mod 2, (A.6) 

a=l 

for a Pin~ structure. In particular, when E = D 2 , go = and m = 1 we have 

sigr^iDa) = ^ ^ ^ + deg $ mod 2. (A.7) 

Definition A. 3 A short exact sequence of families of Fredholm operators 

D' D D" 

consists of a base parameter space B, two short exact sequences of Banach space bundles 
over B 

o -> x' -> x -> x" -»• o, o -»• y' -> y -»• y" -»• o. 

and i/iree Fredholm morphisms of Banach bundles 

D : X It :X'->Y' D" : X" -> y", 

suc/i £/iai i/ie following diagram commutes 

o — ► y — ► y — ► y" — ► o 

£)' t D t £>" t 

— > X' — > X — ► X" — > 

The following lemma will be used in section 8. 
Lemma A.l A short exact sequence of families of Fredholm operators 

-> £>' -> L> -> D" -> 

induces an isomorphism 

det(D') ® det(D") ~ det(D). 
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